Methods and apparatus to operate a mobile camera for low-power usage

ABSTRACT

A disclosed example to operate a mobile camera includes recognizing a first feature in first sensor data in response to the first feature being detected in the first sensor data; transitioning the mobile camera from a first feature detection state to a second feature detection state in response to the recognizing of the first feature, the mobile camera to operate using higher power consumption in second feature detection state than in the first feature detection state; recognizing a second feature in second sensor data in the second feature detection state; and sending to an external device at least one of first metadata corresponding to the first feature or second metadata corresponding to the second feature.

RELATED APPLICATIONS

This patent arises from a continuation of U.S. patent application Ser.No. 16/746,439, filed on Jan. 17, 2020, which is a continuation of U.S.patent application Ser. No. 15/870,007, filed on Jan. 12, 2018, now U.S.Pat. No. 10,574,890, both of which are hereby incorporated herein byreference in their entireties.

FIELD OF THE DISCLOSURE

This disclosure is generally related to mobile computing, and morespecifically to methods and apparatus to operate a mobile camera forlow-power usage.

BACKGROUND

Digital cameras are often integrated into handheld mobile computingdevices such as cellular telephones and handheld media devices. Digitalcameras are also often integrated into other types of computing devicessuch as tablet computing devices and laptop computers. Such digitalcameras are operated by users to capture digital images and videos.Digital images and videos can be stored locally at a memory of thecomputing device in which the digital camera is integrated, or they canbe sent to a network-accessible storage location across a public networksuch as the Internet or across a private network. In any case, thedigital images and videos may be subsequently accessed by theoriginators of those images and videos or by other persons having accessprivileges.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A illustrates an example mobile camera implemented in accordancewith teachings of this disclosure.

FIG. 1B illustrates an example hardware platform that may be used toimplement the mobile camera shown in FIG. 1A.

FIG. 2 illustrates example mobile phone host devices in wirelesscommunication with corresponding mobile cameras and a cloud system.

FIG. 3 illustrates an example multiple power-level operating statehierarchy for use with the mobile cameras of FIGS. 1A, 1B, and 2 .

FIG. 4 illustrates a line graph of example power usage by the mobilecameras of FIGS. 1A, 1B, and 2 at the different power-level operatingstates of FIG. 3 .

FIGS. 5A and 5B depict an example implementation of the visionprocessing unit (VPU) of FIGS. 1A and 1B that may be used in the mobilecameras of FIGS. 1A, 1B, and 2 to operate at the different power-leveloperating states of FIG. 3 in accordance with teachings of thisdisclosure.

FIG. 5C depicts an example state-order configurator that may be usedwith the VPU depicted in FIGS. 5A and 5B to configure the ordering ofthe different power-level operating states of FIG. 3 .

FIG. 6 illustrates a flowchart representative of examplemachine-readable instructions that may be executed to implement themobile cameras of FIGS. 1A, 1B, and 2 and/or the VPU 108 of FIGS. 1A,1B, 5A, 5B, and 5C to operate at the different power-level operatingstates of FIG. 3 .

FIG. 7 illustrates a processor platform capable of executing themachine-readable instructions of FIG. 6 to implement the mobile camerasof FIGS. 1A, 1B, and 2 and/or the VPU 108 of FIGS. 1A, 1B, 5A, 5B, and5C to operate at the different power-level operating states of FIG. 3 .

The figures are not to scale. Instead, for purposes of clarity,different illustrated aspects may be enlarged in the drawings. Ingeneral, the same reference numbers will be used throughout the drawingsand accompanying written description to refer to the same or like parts.

DETAILED DESCRIPTION

Example methods and apparatus disclosed herein operate mobile cameraswith low-power usage. Examples disclosed herein may operate mobilecameras which have limited power sources while enabling numerous usesfor the mobile cameras for productivity, entertainment, and/or astechnologies that assist users in their day-to-day activities (e.g.,assistive technologies). Example mobile cameras disclosed herein operatein a low-power feature monitoring mode and one or more higher-poweractive modes. The low-power feature monitoring mode enables a mobilecamera to monitor characteristics of its surrounding environment whileconsuming little power (e.g., ˜2 milliwatts or less). In the low-powerfeature monitoring mode, environment analysis logic of an example mobilecamera monitors environmental characteristics to identify features ofinterest representing stimuli that warrant transitioning the mobilecamera to a higher-power active mode in which the mobile camera canmonitor additional types of environmental characteristics and/or captureone or more high-quality visual captures. As used herein, “visualcaptures” are images and/or video captured by one or more cameras. Inexamples disclosed herein involving the processing of a visual capture,the visual capture may be a single image capture or may be a frame thatis part of a sequence of frames of a video capture.

Example environmental characteristics monitored by mobile camerasdisclosed herein include visual characteristics, audio characteristics,and/or motion characteristics. To monitor such environmentalcharacteristics, example mobile cameras disclosed herein are providedwith multiple sensors. Example sensors include cameras, microphones,and/or motion detectors. Other types of sensors may also be providedwithout departing from the scope of this disclosure. By using alow-power feature monitoring mode to monitor environmentalcharacteristics, examples disclosed herein enable mobile cameras tooperate for long durations (e.g., days or weeks) at relatively low ratesof battery drain.

Examples disclosed herein also enable such power-conservative mobilecameras to intelligently detect when to transition into one or morehigher-power active modes based on one or more detected environmentalstimuli. That is, examples disclosed herein identify some environmentalstimuli as trigger features that, when detected, indicate that a mobilecamera is to be transitioned to a higher-power active mode to enableadditional functionality of the mobile camera. For example, in alowest-power feature monitoring mode, a mobile camera may power itsmotion detection subsystem and/or its audio monitoring subsystem whilemaintaining other sensor subsystems in a low-power standby mode. Upondetecting a motion trigger feature (e.g., a threshold amount ofmovement) and/or an audio trigger feature (e.g., a keyword, a particularsound, an animal sound, a vehicle sound, a human sound, a householdsound, an industrial sound, etc.), the mobile camera may transition intoa next higher-power mode in which a low-resolution camera is powered tocapture low-resolution visual captures. The mobile camera may thenanalyze the low-resolution visual captures using machine visionprocesses to monitor for visual trigger features (e.g., faces, objects,vehicles, etc.). Upon detecting a visual trigger feature, the mobilecamera may transition into a next higher-power mode in which one or moreadditional subsystems of the mobile camera are enabled. In someexamples, the highest high-power active mode of the mobile camera mayinvolve enabling one or more high-resolution cameras to capturehigh-quality visual captures. In such manners, examples disclosed hereinenable mobile cameras to operate in power-constrained configurations forlong durations while the mobile cameras intelligently operateintermittently in higher-power modes to capture high-quality data suchas high-resolution visual captures of their surrounding environments.

FIG. 1A illustrates an example mobile camera 100 that includes aplurality of example cameras 102, an example inertial measurement unit(IMU) 104, an example audio codec (AC) 106, an example vision processingunit (VPU) 108, and an example wireless communication interface 110.FIG. 1B is an example hardware platform that may be used to implementthe mobile camera 100 of FIG. 1A. The example mobile camera 100 may be awearable camera and/or a mountable camera. A wearable camera may be wornor carried by a person. For example, the person may pin or attach thewearable camera to a shirt or lapel, wear the wearable camera as part ofeyeglasses, hang the wearable camera from a lanyard around their neck,clip the wearable camera to their belt via a belt clip, clip or attachthe wearable camera to a bag (e.g., a purse, a backpack, a briefcase,etc.), and/or wear or carry the wearable camera using any other suitabletechnique. In some examples, a wearable camera may be clipped orattached to an animal (e.g., a pet, a zoo animal, an animal in the wild,etc.). A mountable camera may be mounted to robots, drones, orstationary objects in any suitable manner to monitor its surroundings.

Example mobile cameras disclosed herein implement eyes on things (EOT)devices that interoperate with an EOT platform with which computers(e.g., servers, client devices, appliances, etc.) across the Internetcan communicate via application programming interfaces (APIs) to accessvisual captures of environments, persons, objects, vehicles, etc. Forexample, a cloud service (e.g., provided by the cloud system 206) mayimplement such EOT platform to collect and/or provide access to thevisual captures. In some examples, such visual captures may be theresult of machine vision processing by the EOT devices and/or the EOTplatform to extract, identify, modify, etc. features in the visualcaptures to make such visual captures more useful for generatinginformation of interest regarding the subjects of the visual captures.

The example cameras 102 are provided to capture visual captures (e.g.,images and/or video) and may be implemented using, for example, one ormore CMOS (complementary metal oxide semiconductor) image sensor(s)and/or one or more CCD (charge-coupled device) image sensor(s). In theillustrated example of FIGS. 1A and 1B, the plurality of cameras 102includes two low-resolution cameras 102 a,b and two high-resolutioncameras 102 c,d. However, in other examples, some or all of the cameras102 may be low resolution, and/or some or all may be high resolution.

Turning briefly to the example of FIG. 1B, the low-resolution cameras102 a,b are in circuit with the VPU 108 via a plug-in board 152 whichserves as an expansion board through which additional sensors may beconnected to the VPU 108. An example multiplexer 154 is in circuitbetween the VPU 108 and the plug-in board 152 to enable the VPU 108 toselect which sensor to power and/or to communicate with on the plug-inboard 152. Also in the illustrated example of FIG. 1B, thehigh-resolution camera 102 c is in circuit directly with the VPU 108.The low-resolution cameras 102 a,b and the high-resolution camera 102 cmay be connected to the VPU via any suitable interface such as a MobileIndustry Processor Interface (MIPI) camera interface (e.g., MIPI CSI-2or MIPI CSI-3 interface standards) defined by the MIPI® Alliance CameraWorking Group, a serial peripheral interface (SPI), an I2C serialinterface, a universal serial bus (USB) interface, a universalasynchronous receive/transmit (UART) interface, etc. The high-resolutioncamera 102 d of the illustrated example is shown as a low-voltagedifferential signaling (LVDS) camera that is in circuit with the VPU 108via a field programmable gate array (FPGA) 156 that operates as an LVDSinterface to convert the LVDS signals to signals that can be handled bythe VPU 108. In other examples, the VPU 108 may be provided with a LVDSinterface and the FPGA 156 may be omitted. In other examples, anycombination of the low-resolution cameras 102 a,b and thehigh-resolution cameras 102 c,d may be in circuit with the VPU 108directly, indirectly, and/or via the plug-in board 152. In any case, themobile camera 100 can completely power off any or all the cameras 102a-d and corresponding interfaces so that the cameras 102 a-d and thecorresponding interfaces do not consume power.

In the illustrated examples of FIGS. 1A and 1B, the low-resolutioncameras 102 a,b consume substantially lower power than thehigh-resolution cameras 102 c,d. As such, in some examples, thelow-resolution cameras 102 a,b can be implemented as low-power always on(AoN) cameras. To conserve battery power, the mobile camera 100 operatesin a low-power feature monitoring mode in which the high-resolutioncamera(s) 102 c,d is/are placed or set in a low-power standby mode(e.g., a mode in which the high-resolution camera(s) 102 c,d consumevery little power or no power) until the VPU 108 detects a visualfeature of interest in one or more visual captures from thelow-resolution camera(s) 102 a,b. When such a visual feature of interestis detected, the mobile camera 100 transitions to a higher-power activemode in which the high-resolution camera(s) 102 c,d is/are placed or setin an active mode to be powered up to capture a higher quality visualcapture (e.g., of the visual feature of interest) than is possible ofbeing captured using the low-resolution cameras 102 a,b. In this manner,the power consumption attributable to visual monitoring by the mobilecamera 100 can be maintained relatively low using examples disclosedherein by using the low-resolution cameras 102 a,b during the low-powerfeature monitoring mode until a feature of interest is detected.Relatively more power drawn by the high-resolution cameras 102 c,d needonly be provided by the mobile camera 100 when the feature of interestis detected.

In some examples, the multiple cameras 102 a-d of the illustratedexample may be mechanically arranged to produce visual captures ofdifferent overlapping or non-overlapping fields of view. Visual capturesof the different fields of view can be aggregated to form a panoramicview of an environment or form an otherwise more expansive view of theenvironment than covered by any single one of the visual captures from asingle camera. In some examples, the multiple cameras 102 a-d may beused to produce stereoscopic views based on combining visual capturescaptured concurrently via two cameras. In some examples, as in FIGS. 1Aand 1B, a separate high-resolution camera may be provided for eachlow-resolution camera. In other examples, a single low-resolution camerais provided for use during a low-power feature monitoring mode, andmultiple high-resolution cameras are provided to generate high-qualitymulti-view visual captures and/or high-quality stereoscopic visualcaptures when feature of interest confirmations are made using thelow-resolution camera. In some examples in which the mobile camera 100is mounted on non-human carriers such as unmanned aerial vehicles(UAVs), robots or drones, the mobile camera 100 may be provided withmultiple cameras mounted around a 360-degree arrangement and top andbottom placements so that the multiple cameras can provide a completeview of an environment. For example, if the mobile camera 100 is mountedon a drone, it may have six cameras mounted at a front position, a backposition, a left position, a right position, a top position, and abottom position. In some examples, a single or multiple low-resolutionand/or low-power cameras can be connected to the mobile camera 100through a length of cable for use in applications that requireinserting, feeding, or telescoping a camera through an aperture orpassageway that is inaccessible by the mobile camera 100 in itsentirety. Such an example application is a medical application in whicha doctor needs to feed cameras into the body of a patient for furtherinvestigation, diagnosis, and/or surgery.

The example IMU 104 of FIGS. 1A and 1B is an electronic device thatmeasures and reports movements in three-dimensional (3D) spaceassociated with a carrier (e.g., a person, object, drone, UAV, vehicle,etc.) of the mobile camera 100 such as force, angular rate, and/orsurrounding magnetic field. To measure such movements, the example IMU104 may be in circuit with one or more motion sensors 158 (FIG. 1B) suchas one or more accelerometers, one or more gyroscopes, one or moremagnetometers, etc. The example AC 106 can be used to detect ambientsounds including speech generated by a person carrying the mobile camera100 and/or generated by persons in proximity to the mobile camera 100.To detect such sounds, the AC 106 may be in circuit with one or moremicrophones 162 (FIG. 1B). In other examples, other sensor interfacesmay be provided to monitor for other environmental characteristics. Forexample, the mobile camera 100 may additionally or alternatively beprovided with a temperature sensor interface, a pressure sensorinterface, a humidity sensor interface, a radiation sensor interface, awind sensor interface, a period movement sensor interface, an abruptmovement sensor interface, an air quality sensor interface, aparticulates sensor interface, a pH sensor interface, etc. The examplemobile camera 100 may be provided with any suitable sensors to measureor monitor any environmental characteristics in home, commercial, and/orindustrial environments.

The example VPU 108 is provided to perform computer vision processing toprovide visual awareness of surrounding environments. The example VPU108 also includes capabilities to perform motion processing and/or audioprocessing to provide motion awareness and/or audio awareness. Forexample, the VPU 108 may interface with multiple sensors or sensorinterfaces, including the cameras 102, the IMU 104, the motion sensors158, the AC 106, and/or the microphone 162 to receive multiple sensorinput data. The example VPU 108 of FIG. 1A is provided with one or moreconvolutional neural network (CNN) feature analyzers 114, one or morecomputer vision (CV) analyzers 116, and/or one or more audio digitalsignal processors (DSPs) 118 to process such sensor input data asdescribed below in connection with FIGS. 5A and 5B. In this manner, theexample VPU 108 can perform visual processing, motion processing, audioprocessing, etc. on the sensor input data from the various sensors toprovide visual awareness, motion awareness, and/or audio awareness. TheVPU 108 of the illustrated example may be implemented using a VPU fromthe Myriad™ X family of VPUs and/or the Myriad™ 2 family of VPUsdesigned and sold by Movidius™, a company of Intel Corporation.Alternatively, the example VPU 108 may be implemented using any othersuitable VPU.

In the illustrated example, the VPU 108 processes pixel data from thecameras 102, motion data from the IMU 104, and/or audio data from the AC106, and generates sensor-based metadata describing such sensor data. Bygenerating such sensor-based metadata, the mobile camera 100 cancommunicate the sensor-based metadata to a host device (e.g., a mobilephone 202 of FIG. 2 ) and/or a cloud service (e.g., provided by thecloud system 206 of FIG. 2 ) for processing instead of communicating theraw sensor data (e.g., the pixel data, the audio data, and/or the motiondata). In this manner, in terms of visual captures, identities orprivacies of individuals and/or private/personal property appearing invisual captures are not inadvertently exposed to other networked devicesor computers connected to the Internet that may maliciously orinadvertently access such visual captures during transmission across theInternet. Such privacy protection associated with transmitting metadatainstead of raw visual captures is useful to provide mobile cameras thatcomply with government and/or industry regulations regarding privacyprotections of personal information. An example of such a governmentregulation of which compliance can be facilitated using examplesdisclosed herein is the European Union (EU) General Data ProtectionRegulation (GDPR), which is designed to harmonize data privacy lawsacross Europe, to protect and empower all EU citizens regarding dataprivacy, and to reshape the way organizations across the EU regionapproach data privacy. In addition, sending small-sized metadata, whichcan be encrypted and coded for additional security, significantlyreduces power consumption that would otherwise be needed fortransmitting the raw sensor data.

In some examples, mobile cameras disclosed herein may operate in animage/video output mode in which the mobile cameras output visualcaptures for storing at a host device and/or at a cloud service. In thismanner, users may use the mobile camera 100 to generate picture and/orvideo memories for long-term storage and subsequent viewing by themand/or others that have been granted access privileges. Example mobilecameras disclosed herein may be provided with a user-controllable orsystem-controllable setting to set when a mobile camera is to operate ina metadata output mode or in an image/video output mode.

The example wireless communication interface 110 of FIGS. 1A and 1B maybe implemented using any suitable wireless communication protocol suchas the Wi-Fi wireless communication protocol, the Bluetooth® wirelesscommunication protocol, the Zigbee® wireless communication protocol,etc. The wireless communication interface 110 may be used to communicatewith a host device (e.g., one of the mobile phone host devices 202 ofFIG. 2 ) and/or other mobile cameras via client/server communicationsand/or peer-to-peer communications.

FIG. 2 illustrates example mobile phone host devices 202 in wirelesscommunication with corresponding example mobile cameras 204 and anexample cloud system 206. In the illustrated example of FIG. 2 , themobile phone host devices 202 serve as host devices to receiveinformation from and send information to the example mobile cameras 204.The mobile phone host devices 202 also communicatively connect themobile cameras 204 to a cloud service provided by the cloud system 206.Although the host devices 202 are shown as mobile phones, in otherexamples host devices 202 may be implemented using any other type ofcomputing device including smartwatch or other wearable computingdevices, tablet computing devices, laptop computing devices, desktopcomputing devices, Internet appliances, Internet of Things (IoT)devices, etc. The example mobile cameras 204 are substantially similaror identical to the mobile camera 100 of FIGS. 1A and 1B.

In the illustrated example of FIG. 2 , the mobile cameras 204 wirelesslycommunicate with their corresponding mobile phone host devices 202 usingwireless communications 208 via wireless communication interfaces suchas the wireless communication interface 110 of FIGS. 1A and 1B. Inaddition, the example mobile phone host devices 202 communicatewirelessly with the cloud system 206 via, for example, a cellularnetwork, a Wi-Fi, or any other suitable wireless communication means. Inany case, the mobile phone host devices 202 and the cloud system 206communicate via a public network such as the Internet and/or via aprivate network. In some examples, the mobile cameras 204 may beconfigured to communicate directly with the cloud system 206 without anintervening host device 202. In yet other examples, a host device 202may be combined with a mobile camera 204 in a same device or housing.

The example cloud system 206 is implemented using a plurality ofdistributed computing nodes and/or storage nodes in communication withone another and/or with server hosts via a cloud-based networkinfrastructure. The example cloud system 206 provides cloud services tobe accessed by the mobile phone host devices 202 and/or the mobilecameras 204. Example cloud services may include metadata processing andinformation retrieval services to analyze and recognize metadatagenerated by the mobile cameras 204 and/or the mobile phone host devices202, and retrieve information from storage devices corresponding to themetadata. The cloud system 206 can communicate such retrievedinformation to the mobile phone host devices 202 for use by the mobilephone host devices 202 and/or the mobile cameras 204 and/or for viewingby users of the mobile phone host devices 202. Example cloud servicesmay additionally or alternatively include image storage and/or videostorage services to store visual captures from the mobile cameras 204.In some examples, the cloud system 206 may be replaced by a server-basedsystem and/or any other network-based system in which the mobile phonehost devices 202 communicate with central computing and/or storagedevices of the network-based system.

The example mobile cameras 204 and the mobile phone host devices 202 arelogically located at an edge of a network since they are the endpointsof data communications. In the illustrated example, sensor-basedmetadata and/or visual captures from the mobile cameras 204 may bestored and/or processed at the edge of the network (e.g., by the mobilecameras 204 and/or by the corresponding mobile phone host devices 202)and/or at the cloud system 206. Processing visual captures at the edgeof the network instead of at the cloud system 206 offloads processingrequirements from the cloud system 206. For example, processingrequirements for computer vision analyses are distributed acrossmultiple mobile cameras 204 and/or mobile phone host devices 204 so thateach mobile camera 204 and/or mobile phone host device 202 can use itsprocessing capabilities for computer vision analyses of visual capturesand generate metadata so that the cloud system 206 need not be equippedwith the significant additional CPU (central processing unit) resources,GPU (graphic processing unit) resources, and/or memory resourcesrequired to perform such computer vision analyses for a large number ofvisual captures received from a large number of networked mobile cameras204. In addition, computer vision analyses can be done faster whenperformed in parallel at distributed mobile cameras 204 rather thanperformed in seriatim in a central location such as the cloud system206.

In some examples, the mobile cameras 204 are concurrently used indifferent environments and communicate sensor-based metadata and/orvisual captures to the cloud system 206 based on those differentenvironments. In other examples, two or more of the mobile cameras 204operate in a same environment such that they can produce visual capturesfrom different perspectives or different fields of view of the sameenvironment. In such examples, the visual captures from the differentmobile cameras 204, when considered in the aggregate, form a panoramicview of the environment or form an otherwise more expansive view of theenvironment than can be covered by any single one of the visual capturesfrom a single mobile camera 204. In yet other examples, a single mobilecamera 204 is provided with multiple cameras as described above inconnection with FIGS. 1A and 1B to provide a panoramic or more expansiveview of its environment.

In the illustrated example, each mobile camera 204 is physicallyseparate from its corresponding mobile phone host device 202 so that themobile camera 204 can be worn by a person while the mobile phone hostdevice 202 can be stowed away in a purse, a bag, and/or a pocket. Thiseliminates the need for a person using such a camera to pull out theirmobile phone to capture images or video since such visual captures canbe made by the mobile camera 204. In addition, such arrangement isuseful to assist people as they navigate throughout their differentenvironments. For example, a person may be viewing their mobile phonewhile walking along a busy sidewalk. To prevent the person'sdistractedness from creating a dangerous situation, the mobile camera204 may operate as another set of eyes to identify other upcomingpeople, vehicles, or other obstacles and warn the person of thosesurrounding elements. As such, example mobile cameras disclosed hereinmay operate as an “eyes always on the world” device to providesupplemental information to users about their surroundings. For example,a mobile camera 204 may perform computer vision analyses on a stream ofvisual captures as a person walks along the sidewalk to generatemetadata identifying an approaching curb of the sidewalk by detecting acorresponding image feature such as an image of the curb, an edge of thecurb, a line of the curb, etc. The mobile camera 204 may generatecurb-warning metadata and communicate such metadata to a correspondingmobile phone host device 202 or other wearable device (e.g., smartglasses, an assistive device, etc.). The mobile phone host device 202may handle the curb-warning metadata by emitting an audible warningand/or displaying a notification to the person indicating that theperson should be cautious of the curb and/or an approaching vehiclebeyond the curb. In some examples, stereoscopic images and/or videocaptured by the mobile camera 204 may be used to determine distancesbetween the person and approaching obstacles (e.g., the vehicle or thecurb) and/or speeds at which the person is becoming closer to theapproaching obstacles. Such distance and/or speed information can beprovided to the person via the person's mobile phone host device 202 orother computing device such as a wearable device.

In some examples, the mobile cameras 204 may be used to identify otherpeople and/or other features of interest within visual proximity of themobile cameras 204. In such examples, the mobile cameras 204 may be wornon lapels, shirts or at some location on persons carrying the mobilecameras 204. For example, a mobile camera 204 may be worn by a person ata conference or tradeshow in which numerous other people are inattendance and at which numerous facilities (e.g., cafeteria, phonecharging stations, conference rooms, restrooms, etc.) and/or vendorbooths are available. The person may recognize another attendee but notremember the name of the attendee or other information about theattendee (e.g., name, title, employer, last meeting, last interaction,last communication, etc.). In such a situation, the mobile camera 204proactively generates and analyzes visual captures of the otherattendee, and communicates with a cloud service hosted by the cloudsystem 206 to obtain pertinent information about the other attendee foraccess by the person wearing the mobile camera 204. This informationabout the attendee may be useful to refresh the person's memory aboutthe attendee and/or to newly inform the person about the attendee sothat the person may make a more informed and relevant introduction withthe attendee. In some examples, the associated mobile phone host device202 generates an alert (e.g., an audible alert, a vibrating alert, adisplay notification, etc.) notifying the person when the informationabout the attendee has been received from the cloud service. In thismanner, the person need not expend effort and time to actively sendrequests for information. Instead, the mobile camera 204, the mobilephone host device 202, and the cloud system 206 operate without userintervention to provide such information.

In some examples, the cloud service provided by the cloud system 206 isa social network service (e.g., Facebook, Twitter, etc.) or a businessnetwork service (e.g., LinkedIn) having registered subscribers, profileinformation about those subscribers, calendar information about thosesubscribers, email and instant messaging information about thosesubscribers, etc. In this manner, when the cloud service receivessensor-based metadata and/or visual captures generated by the mobilecameras 204, the cloud service can leverage such subscriber informationto provide relevant information about the people represented in thesensor-based data and/or visual captures. In other examples, the cloudservice communicates with other subscriber-model services such as socialnetwork service or business network services to access such subscriberinformation in accordance with permissions granted by those subscribersfor providing access to their subscriber information.

In some examples, the mobile cameras 204 may also be used to recognizeand access information about non-human objects. For example, the mobilecameras 204 may be used by patrons in an art museum to recognizedifferent pieces of art, retrieve information (e.g., artwork name,artist name, creation date, creation place, etc.) about such art fromthe cloud service and access the retrieved information via the mobilephone host devices 202.

In examples disclosed herein, the mobile phone host devices 202 areprovided with example information brokers (IBs) 210 to transferinformation between mobile cameras 204 and a cloud service provided bythe cloud system 206. In the illustrated example, the informationbrokers 210 are implemented using an MQTT (Message Queue TelemetryTransport) protocol. The MQTT protocol is an ISO standard (ISO/IEC PRF20922) publish-subscribe-based messaging protocol that works on top ofthe TCP/IP protocol. In examples disclosed herein, the MQTT protocol canbe used as a lightweight messaging protocol for small sensors (e.g., themobile cameras 204) and mobile devices (e.g., the mobile phone hostdevices 202) to handle communications for high-latency and/or unreliablenetworks. In this manner, examples disclosed herein can employ the MQTTprotocol as a low-power and low-bandwidth protocol to maintain efficientand reliable communications between the mobile cameras 204 and themobile phone host devices 202 using peer-to-peer (P2P) communicationsand/or for exchanging information such as metadata and/or visualcaptures with cloud services or other networked devices. Using theinformation brokers 210, lightweight communications can be used to sendlightweight data (e.g., metadata extracted by the mobile cameras 204from visual captures) from the mobile cameras 204 and/or the mobilephone host devices 202 to a cloud service. In such examples, the mobilecameras 204 can process visual captures at the edge of a network andconsume fewer amounts of network bandwidth to transfer resultingmetadata to a cloud service.

FIG. 3 illustrates an example multiple power-level operating statehierarchy 300 for use with the mobile cameras 100, 204 of FIGS. 1A, 1B,and 2 . The example multiple power-level operating state hierarchy 300can be used to enable low power usage for the mobile cameras 100, 204and, thus, conserve battery charge. The example multiple power-leveloperating state hierarchy 300 enables low power usage based on thepremise that, much of the time, the example mobile cameras 100, 204 arenot performing compute-intensive processes and/or collectinghigh-quality visual captures. For example, in a low-power featuremonitoring mode, a mobile camera 100, 204 may monitor motion sensordata, audio sensor data and/or low-resolution visual captures (e.g.,performing CNN inference processes) to identify trigger features thatcould cause the mobile camera 100, 204 to transition to one or morehigher power modes.

In some examples, the multiple power-level operating state hierarchy 300can be used to control the power-on or active state of a wirelesscommunication subsystem (e.g., the wireless communication interface 110of FIGS. 1A and 1B) of a mobile camera 100, 204. For example, at lowerpower states of the multiple power-level operating state hierarchy 300,the mobile camera 100, 204 may refrain from generating metadata needingto be communicated to a cloud service provided by the cloud system 206.In such scenarios, the wireless communication interface 100 can be keptin a low-power mode to conserve battery power.

The operating states of the example multiple power-level operating statehierarchy 300 include an example reset state 302, an example motionfeature detection state 304, an example audio feature detection state306, an example low-resolution camera feature detection state 308, anexample computer vision processing feature detection state 310, anexample CNN feature detection state 312, an example high-resolutioncamera feature detection state 314, and an example video capture state316.

FIG. 4 illustrates an example power usage trend of the mobile camera100, 204 that depicts relative power usage between the different powerstates 302, 304, 306, 308, 310, 312, 314, and 316. In the illustratedexample of FIG. 4 , the lowest power state is the reset state 302, andthe highest power state is the video capture state 316. As the mobilecamera 100, 204 progresses along the different power states 302, 304,306, 308, 310, 312, 314, and 316 from the reset state 302 to the videocapture state 316, processing resources and electrical current drawn bythe subsystems of the mobile camera 100, 204 increase which, in turn,increases power consumption.

In the example reset state 302, much of the mobile camera 100, 204 is ina low-power mode in which only a small amount of electrical power isused to power system-critical components such as a real-time clock tomaintain system time, external interrupt inputs to respond tosensor-based wakeup events, a watchdog timer to schedule periodic oraperiodic wakeup events, etc., while other subsystems are in a low-powerstandby mode. During wakeup events, the mobile camera 100, 204 mayanalyze input sensor data to identify trigger features that cause themobile camera 100, 204 to transition to higher power states. In examplesdisclosed herein, trigger features that cause the mobile camera 100, 204to transition between the different power states of the multiplepower-level operating state hierarchy 300 may be detected by the IMU104, the AC 106, and/or the VPU 108, and/or may be detected bymonitoring circuits provided in intelligent sensors that are in circuitwith sensor interfaces of the IMU 104, the AC 106, and/or the VPU 108.For example, small amounts of power (e.g., ˜2 milliwatts) may beprovided (e.g., periodically or aperiodically) to the IMU 104, the AC106, and/or the VPU 108 to process sensor data from correspondingsensors to identify trigger features. Alternatively, small amounts ofpower (e.g., ˜2 milliwatts) may be provided (e.g., periodically oraperiodically) to monitoring circuits in the intelligent sensors so thatthe monitoring circuits can analyze sensor data generated by the sensorsto identify trigger features. In such examples, upon detecting triggerfeatures, sensors may send external interrupts to corresponding sensorsubsystems (e.g., the IMU 104, the AC 106, and/or the VPU 108) to wakeup the sensor subsystems and initiate transitions between the differentpower states of the multiple power-level operating state hierarchy 300.

An example usage scenario of power state transitions involves a personwearing a mobile camera 100, 204. When the person is inactive such asstanding still, sitting, or sleeping, the mobile camera 100, 204 mayenter the reset state 302 as a result of the mobile camera 100, 204 notdetecting any motion associated with the person. However, when theperson moves, the mobile camera 100, 204 may incrementally enter intohigher power states (e.g., the motion feature detection state 304, theaudio feature detection state 306, etc.) based on the amount of motiondetected by the mobile camera 100, 204. For example, a person may beginwalking which causes the mobile camera 100, 204 to enter the audiofeature detection state 306 and begin analyzing audio sensor datarepresentative of surrounding speech, sound, noise, etc. and/or at somepoint the mobile camera 100, 204 may transition into the low-resolutioncamera feature detection state 308 to analyze low-resolution visualcaptures of surrounding areas. In the audio feature detection state 306,the mobile camera 100, 204 may monitor for the presence of, for example,other people by recognizing speech. In the example low-resolution camerafeature detection state 308, the mobile camera 100, 204 may monitor forthe presence of, for example, other people or other features of interestbased on visual confirmations. In some examples, the mobile camera 100,204 may skip one or more operating states to move to higher or lowerpower states along the multiple power-level operating state hierarchy300. For example, detecting a running motion in the motion featuredetection state 304 may cause the mobile camera 100, 204 to transitionfrom the motion feature detection state 304 to the low-resolution camerafeature detection state 308 and/or to the video capture state 316. Insuch an example, the low-resolution feature detection state 308 may beused to analyze images of distant objects that a person carrying themobile camera 100, 204 may quickly approach due to the running activity.The low-resolution feature detection state 308 would be more suitablefor detection than the audio feature detection state 306 due to thedistance of far away objects and/or due to noisy wind, breathing, shoe,or friction sounds generated while running. The example video capturestate 316 may be activated during such detected running to record videofor safety purposes and/or if the person has preconfigured the mobilecamera 100, 204 to record runs for personal video purposes. When therunning activity stops, the mobile camera 100, 204 may transition byskipping multiple operating states down the multiple power-leveloperating state hierarchy 300, for example, from the video capture state316 directly to the reset state 302.

In the example multiple power-level operating state hierarchy 300 ofFIG. 3 , during wakeup events from the reset state 302, the mobilecamera 100, 204 can provide a small amount of electrical power to amotion sensor interface of the IMU 104 (FIG. 1A) to receive motionsensor data via one or more motion sensors of the mobile camera 100,204. In the motion feature detection state 304, the example IMU 104 canmeasure or analyze the motion activity represented by the motion sensordata to identify a motion feature trigger. For example, a motion featuretrigger could be a threshold amount of motion activity that causes themobile camera 100, 204 to remain in the motion feature detection state304 or transition to the audio feature detection state 306. When the IMU104 does not detect a certain amount of threshold motion activity duringthe motion feature detection state 304 to remain in the motion featuredetection state 304 or to enter the audio feature detection state 306,the mobile camera 100, 204 returns to the reset state 302. In someexamples, the mobile camera 100, 204 stays in the motion featuredetection state 304 when the IMU 104 detects a first amount of thresholdmotion activity and enters the audio feature detection state 306 whenthe IMU 104 detects a second amount of threshold motion activity. Forexample, the first amount of threshold motion activity could besufficient activity that warrants staying in the motion featuredetection state 304 to continue monitoring motion activity that couldlead to satisfying the second amount of threshold motion activity totransition to the audio feature detection state 306. The amounts ofthreshold motion activity may be magnitudes of motion and/or durationsof motion.

In the example audio feature detection state 306, the mobile camera 100,204 provides power to the audio codec 106 to receive audio sensor datafrom, for example, a microphone. In this manner, the mobile camera 100,204 can analyze the audio sensor data to identify audio feature triggers(e.g., speech, sound, noise, a dog bark, a cat meow, a door opening, adoor closing, a car engine sound, etc.). In some examples, an audiofeature trigger is based on a rate of change in an audio signal (e.g.,an abrupt sound feature). In some examples in which the mobile camera100, 204 monitors for the presence of people, when the mobile camera100, 204 identifies particular speech (e.g., words and/or phrases basedon speech recognition) and/or identifies a particular speaker (e.g.,based on speaker recognition), the mobile camera 100, 204 transitions tothe low-resolution camera feature detection state 308.

In the example low-resolution camera feature detection state 308, themobile camera 100, 204 powers a camera interface of the VPU 108 (FIGS.1A and 1B) to receive low-resolution visual captures from alow-resolution camera 102 a,b (FIGS. 1A and 1B). In some examples, thelow-resolution camera 102 a,b is provided with motion detectioncapabilities. In this manner, the VPU 108 may remain in a low-powerstate until the low-resolution camera 102 a,b detects a threshold amountof visual motion (e.g., a visual feature trigger) that warrantsnotifying the VPU 108 to transition into a higher power operating state.Detecting sufficient visual motion may be based on whether there issufficient lighting for capturing images having sufficient visibility ofthe surroundings to be adequately processed by the VPU 108. In suchexamples, when lighting is low, the mobile camera 100, 204 may remain inthe low-resolution camera feature detection state 308 or return to theaudio feature detection state 306. As such, the mobile camera 100, 204can conserve battery power by limiting power to the VPU 108 until avisual feature trigger is detected by the low-resolution camera 102 a,b.

When the example low-resolution camera 102 a,b detects a visual featuretrigger, the mobile camera 100, 204 may transition into the computervision processing feature detection state 310. In the computer visionprocessing feature detection state 310, the VPU 108 may analyze visualcaptures from the low-resolution camera 102 a,b to detect whether aperson is within visual proximity of the low-resolution camera 102 a,b.When a face feature in a visual capture from the low-resolution camera102 a,b satisfies a face feature threshold, the mobile camera 100, 204transitions to the CNN feature detection state 312. In the example CNNfeature detection state 312, an example CNN feature analyzer 114 (FIG.1A) of the VPU 108 performs computer vision analyses on the detectedface. The example CNN feature analyzer 114 may compare the detected faceto a database or dictionary of reference face images or reference facemetadata stored locally in the mobile camera 100, 204 and/or in acorresponding mobile phone host device 202 (FIG. 2 ). If the CNN featureanalyzer 114 determines that the detected face matches one of thereference face images, the mobile camera 100, 204 may access a service318 (e.g., via the cloud system 206 of FIG. 2 ) to obtain informationabout the person corresponding to the detected face. Additionally oralternatively, the mobile camera 100, 204 may transition to the examplehigh-resolution camera feature detection state 314 to capture a stillimage of the person corresponding to the detected face and/or maytransition to the example video capture state 316 to capture video ofthe person corresponding to the detected face.

In the illustrated example of FIG. 3 , transitioning between thedifferent states of the multiple power-level operating state hierarchy300 may be based on policies or rules stored in the mobile cameras 100,204 and/or stored in corresponding mobile phone host devices 202 (FIG. 2) for access by the mobile cameras 100, 204. In some examples, thepolicies for transitioning between the different operating states causethe mobile camera 100, 204 to remain in the reset state 302 orrelatively lower power operating states (e.g., the motion featuredetection state 304, the audio feature detection state 306, thelow-resolution camera feature detection state 308) for a majority of thetime such that the mobile camera 100, 204 consumes relatively littlepower. The mobile camera 100, 204 can then transition, from time totime, to operating states that contribute to relatively higher powerconsumption only when necessary to collect high-resolution visualcaptures and/or to access an external service via wirelesscommunications. By transitioning to such higher power operating statesfor only short durations, examples disclosed herein enable keepinghigher power consumption subsystems (e.g., the high-resolution cameras102 c,d of FIGS. 1A and 1B and the wireless communication interface 110of FIGS. 1A and 1B) off most of the time until needing to be used insuch higher power operating states. In this manner, the mobile camera100, 204 can be used for a relatively long time (e.g., days or weeks)between battery charges or battery replacements.

In some examples, the different states of FIG. 3 are used by the mobilecamera 100, 204 to modulate its operation between the differentoperating states based on remaining battery power and desired minutes ofremaining operation. For example, the mobile camera 100, 204 enters abattery-critical mode and operates at lower power states (e.g., themotion feature detection state 304, the audio feature detection state306, the low-resolution camera feature detection state 308) withoutentering higher power states when the remaining battery charge of themobile camera 100, 204 is low and a desired duration of remainingoperation requires less power usage than possible in the higher powerstates. In this manner, the mobile camera 100, 204 can continuemonitoring its surroundings for features of interest and can continue tocollect and store the occurrences of such features of interest withoutentering the higher power states. For example, in the battery-criticalmode, the mobile camera 100, 204 could define the low-resolution camerafeature detection state 308 as a maximum state and use thelow-resolution camera feature detection state 308 to collect visualcaptures instead of transitioning into the high-resolution camerafeature detection state 314.

In the battery-critical mode, policies for transitioning between thedifferent operating states of FIG. 3 may also be adapted so that themobile camera 100, 204 operates in a more power-conservative manner. Forexample, when the mobile camera 100, 204 is not in the battery-criticalmode, a policy for transitioning from the motion feature detection state304 to the audio feature detection state 306 may be that the IMU 104must detect any motion in any direction, while when operating in thebattery-critical mode, the policy for transitioning from the motionfeature detection state 304 to the audio feature detection state 306 maychange to require, for example, a detected change in direction of 90degrees, 180 degrees, etc. In this manner, to further conserve powerduring the battery-critical mode, the mobile camera 100, 204 can remainin lower power states unless it detects feature triggers that arerelatively more significant than would be required when not operating inthe battery-critical mode.

Although the different operating states of the example multiplepower-level operating state hierarchy 300 of FIG. 3 are shown in aparticular order, policies for transitioning between the differentoperating states may define different orders for transitions between thedifferent operating states. For example, a small amount of movementdetected by the IMU 104 may satisfy a low-movement feature detectionthreshold to transition from the motion feature detection state 304 tothe audio feature detection state 306, while a more significant amountof movement detected by the IMU 104 may satisfy a high-movement featuredetection threshold to transition from the motion feature detectionstate 304 to the low-resolution camera feature detection state 308. Inaddition, although the example multiple power-level operating statehierarchy 300 of FIG. 3 shows a transition from the reset state 302 tothe motion feature detection state 304 during wakeup events, a differentwakeup policy may instead be applied to transition the mobile camera100, 204 from the reset state 302 to the audio feature detection state306 during such wakeup events and/or to transition from the reset state302 to both the motion feature detection state 304 and the audio featuredetection state 306 simultaneously. Similarly, in other examples, themobile camera 100, 204 may be provided with policies that definetransitions from one operating state to multiple operating statessimultaneously and/or from multiple operating states in which the mobilecamera 100, 204 is simultaneously operating to a single operating state.Policies for controlling operating states and/or transitions between theoperating states may be user defined (e.g., via the mobile phone hostdevices 202 of FIG. 2 ) and/or system defined (e.g., programmed and/orstored in a configuration file by a developer or manufacturer).

In addition, the example multiple power-level operating state hierarchy300 of FIG. 3 may be modified to include fewer or more and/or differentoperating states than those illustrated in FIG. 3 . In some examples,the operating states and activations of corresponding sensors arerearranged in the multiple power-level operating state hierarchy 300 sothat transitions along the multiple power-level operating statehierarchy 300 cause a different sequence of activations of thecorresponding sensors. For example, the low-resolution camera featuredetection state 308, the high-resolution camera feature detection state314, and the example video capture state 316 may be rearranged so thatthe ordering in which each of those states is activated along themultiple power-level operating state hierarchy 300 is different. Forexample, one or more of the high-resolution cameras 102 c,d may beactivated during the high-resolution camera feature detection state 314before activating the low-resolution cameras 102 a-b during thelow-resolution camera feature detection state 308. In some examples, theordering of the operating states of the multiple power-level operatingstate hierarchy 300 is static and unchangeable. In other examples, theordering of the operating states of the multiple power-level operatingstate hierarchy 300 is dynamic so that it may be changed using, forexample, policy definitions.

FIGS. 5A and 5B depict an example block diagram of the VPU 108 of FIGS.1A and 1B that may be used to implement the mobile cameras 100, 204 ofFIGS. 1A, 1B, and 2 to operate at the different power-level operatingstates of the example multiple power-level operating state hierarchy 300of FIG. 3 . The illustrated example of FIG. 5A shows the low-resolutioncamera 102 a, the IMU 104, the audio codec 106, and the high-resolutioncamera 102 c in circuit with the VPU 108. To perform motion analysis,audio analysis and computer vision analysis, the example VPU 108 isprovided with a number of example CNN feature analyzers (e.g., that arerepresented in FIG. 1A as the CNN feature analyzers 114) as describedbelow. The example CNN feature analyzers are implemented usingconvolutional neural networks that can be trained to detect or recognizedifferent features (e.g., motion, audio, speech, words, persons, faces,objects, etc.) in sensor data (e.g., motion data, audio data, visualcaptures, etc.) provided by the IMU 104, the audio codec 106, and thecameras 102 a-d. For example, the example CNN feature analyzers aretrained to detect or recognize features in the sensor data by motionanalysis algorithms, audio analysis algorithms, computer visionalgorithms (e.g., the CV algorithms 116 of FIG. 1A) to generateprobabilities representative of likelihoods that different features inthe sensor data can be confirmed. In this manner, the example CNNfeature analyzers can generate confirmations for presences of featuresof interest based on probabilities of those features satisfying featureprobability thresholds.

To perform motion analysis during the motion feature detection state 304(FIG. 3 ), the example VPU 108 is provided with an example motionfeature detector 502 that is in circuit with the IMU 104, and an exampleCNN motion activity recognizer 504 that is in circuit with the motionfeature detector 502. The example motion feature detector 502 isprovided to detect motion activity of the mobile camera 100, 204 byreceiving motion sensor data from the IMU 104, and performing motionfeature detection analysis on the motion sensor data to detect movementof the mobile camera 100, 204. In the illustrated example, the examplemotion feature detector 502 is implemented by the DSP 118 of FIG. 1A,and the motion sensor data is raw motion sensor data representative ofmagnitudes and directions of motion or movement detected by the motionsensor(s) 158 (FIG. 1B) that are in circuit with the IMU 104. When theexample motion feature detector 502 detects motion having sufficientmagnitude and/or sufficient duration to satisfy a motion feature triggerthreshold, the motion feature detector 502 sends a motion detectionconfirmation to the CNN motion activity recognizer 504. In addition, themotion detection confirmation causes the VPU 108 to transition to a nexthigher power operating state (e.g., the audio feature detection state306 of FIGS. 3 and 4 ).

The example CNN motion activity recognizer 504 analyzes the motionsensor data to identify particular motion-based activity types that theCNN motion activity recognizer 504 is trained to recognize. Examplemotion-based activity types that may be trained into the CNN motionactivity recognizer 504 include running, jumping, climbing stairs,skipping, at rest, riding in car, riding in train, etc. The example CNNmotion activity recognizer 504 outputs corresponding motion metadata fordifferent recognized activity types shown in the example of FIG. 5A asactivity (1) through activity (n). In the illustrated example, themotion metadata is generated by the CNN motion activity recognizer 504to describe the types of motion recognized in the motion sensor data(e.g., running, jumping, climbing stairs, skipping, at rest, riding incar, riding in train, etc.). In the illustrated example, the CNN motionactivity recognizer 504 generates the motion metadata by accessing themetadata from a local reference motion metadata library or referencemotion metadata database that stores metadata terms in association withcorresponding reference motion feature definitions. To retrieve motionmetadata, the CNN motion activity recognizer 504 can compare motionfeatures from the motion sensor data with the reference motion featuredefinitions in the local reference motion metadata library or database.In some examples, an extended reference motion metadata library orreference motion metadata database may be stored at the cloud system206, and accessed by the CNN motion activity recognizer 504 using anapplication programming interface (API) for such cloud-based library ordatabase. The example recognized activity (1) through activity (n) causethe VPU 108 to transition to a fully awake state. In the illustratedexample, a motion activity multiplexer 506 receives the motion metadatafor the recognized activity (1) through activity (n), and provides themotion metadata as generally indicated by reference numeral 508 to anexample full wake-up event multiplexer 510.

To perform audio analysis during the audio feature detection state 306(FIG. 3 ), the example VPU 108 is provided with an example audio featuredetector 514 that is in circuit with the audio codec 106, an examplevoice activity detector 516 that is in circuit with the audio featuredetector 514, an example CNN wake-up word recognizer 518 that is incircuit with the voice activity detector 516, and an example CNN commandword recognizer 520 that is in circuit with the CNN wake-up wordrecognizer 518. The example audio feature detector 514 is provided todetect audio activity near the mobile camera 100, 204 by receiving audiosensor data from the audio codec 106, and performing audio featuredetection analysis on the audio sensor data. In the illustrated example,the example audio feature detector 514 is implemented by the DSP 118 ofFIG. 1A, and the audio sensor data is raw audio waveform datarepresentative of audio sensed by the microphone 162 (FIG. 1B) that isin circuit with the audio codec 106. When the example audio featuredetector 514 detects audio having sufficient amplitude and/or sufficientduration to satisfy an audio feature trigger threshold, the audiofeature detector 514 sends a sound detection confirmation to the voiceactivity detector 516. In some examples, the feature trigger thresholdis satisfied when the audio feature detector 514 detects a particularrate of change in an audio signal (e.g., an abrupt sound feature). Thesound detection confirmation confirms the presence of sounds in theaudio sensor data that should be further analyzed by the VPU 108. In theillustrated example, the sounds may be any sound or noise such asvoices, handclaps, animal sounds, car horns, gunshots, etc. The examplevoice activity detector 516 analyzes the audio sensor data using voicefeature detection analysis to determine whether any portion of it isrepresentative of a person's voice. For example, the audio sensor datamay be an audio sampling of ambient noise or sounds that are not aperson's voice and/or may be an audio sampling of a person's voice withor without background noise or sounds. In any case, the example voiceactivity detector 516 sends a confirmation of voice detection to the CNNwake-up word recognizer 518 when a voice is detected.

The example CNN wake-up word recognizer 518 analyzes the audio sensordata to identify particular wake-up words that the CNN wake-up wordrecognizer 518 is trained to recognize based on speech recognitionalgorithms. Example wake-up words that may be trained into the CNNwake-up word recognizer 518 include persons names, home, car, outside,inside, please, want, listen, wake-up, record, capture, video, hello,hi, camera-on, camera-off, help, etc. In some examples, wake-up phrasesmay also be defined. The example CNN wake-up word recognizer 518 sends awake-up word detection confirmation to the CNN command word recognizer520 when a wake-up word is detected.

In the illustrated example, the CNN wake-up word recognizer 518 alsogenerates audio metadata corresponding to the analyzed audio sensordata. Such audio metadata may be a name of a speaker, an age of aspeaker, a gender of a speaker, type of command spoken, etc. In theillustrated example, the CNN wake-up word recognizer 518 generates theaudio metadata by accessing the metadata from a local reference audiometadata library or reference audio metadata database that storesmetadata terms in association with corresponding reference audio featuredefinitions. To retrieve audio metadata, the CNN wake-up word recognizer518 can compare audio features from the audio sensor data with thereference audio feature definitions in the local reference audiometadata library or database. In some examples, an extended referenceaudio metadata library or reference audio metadata database may bestored at the cloud system 206, and accessed by the CNN wake-up wordrecognizer 518 using an API for such cloud-based library or database.

The example CNN command word recognizer 520 analyzes the audio sensordata to identify particular command words that the CNN command wordrecognizer 520 is trained to recognize based on speech recognitionalgorithms. In the illustrated example, command words are a subset ofwake-up words such that the wake-up words cause the mobile cameras 100,204 to transition to a higher power operating state (e.g., thelow-resolution camera feature detection state 308 of FIGS. 3 and 4 ),but only a subset of the wake-up words also defined as command wordsthat cause the mobile cameras 100, 204 to transition to a fully awakestate and/or perform corresponding operations. Example command wordsthat may be trained into the CNN command word recognizer 520 includewake-up, record, capture, camera-on, camera-off, help, etc. The exampleCNN command word recognizer 520 outputs corresponding audio metadata fordifferent recognized command words shown in the example of FIG. 5A ascommand (1) through command (n). In the illustrated example, a commandword multiplexer 522 receives the audio metadata for the recognizedcommand (1) through command (n), and provides the audio metadata asgenerally indicated by reference numeral 524 to the example full wake-upevent multiplexer 510.

To perform low-resolution image analysis during the low-resolutioncamera feature detection state 308 (FIG. 3 ), the example VPU 108 isprovided with an example image feature detector 528 that is in circuitwith the low-resolution camera 102 a, an example CNN face detector 530that is in circuit with the image feature detector 528, an example CNNwake-up face recognizer 532 that is in circuit with the CNN facedetector 530, and an example CNN face recognizer 534 that is in circuitwith the CNN wake-up face recognizer 532. The example image featuredetector 528 is provided to detect visible activity near the mobilecamera 100, 204 by receiving low-resolution visual captures from thelow-resolution camera 102 a, and performing image feature detectionanalyses on the low-resolution visual captures. In the illustratedexample, the example image feature detector 528 is implemented by theDSP 118 of FIG. 1A, and the visual captures are in the form of pixeldata (e.g., multi-bit color pixel data or multi-bit black and whitepixel data). In some examples, the low-resolution camera 102 a onlyprovides visual capture data to the image feature detector 528 when thelow-resolution camera 102 a has performed a pre-processing featuredetection process to identify whether a region of interest (RoI) eventis detected. Such a RoI event may occur when there is sufficientlighting in a visual capture to discern a visibly detectable feature inthe visual capture (e.g., more than just a fully saturated dark image).

When the example image feature detector 528 receives a visual capturefrom the low-resolution camera 102 a and detects a visual feature havingsufficient visual definition and/or sufficient duration to satisfy avisual feature trigger threshold, the image feature detector 528 sendsan image detection confirmation to the CNN face detector 530. The imagedetection confirmation confirms the presence of a sufficiently visualfeature in the low-resolution visual capture that should be furtheranalyzed by the VPU 108. In the illustrated example, the visual featuresmay be any visual feature of interest such as objects, people, vehicles,license plates, signs, etc. The example CNN face detector 530 analyzesthe low-resolution visual capture using face feature detection analysisto determine whether any portion of it is representative of a face. Forexample, the low-resolution visual capture may include visual featuresthat are not a person's face and/or may visual feature representative ofa person's face with or without other visual features. In any case, theexample CNN face detector 530 sends a confirmation of face detection tothe CNN wake-up face recognizer 532 when a face is detected.

The example CNN wake-up face recognizer 532 analyzes the low-resolutionvisual capture to identify particular wake-up faces that the CNN wake-upface recognizer 532 is trained to recognize based on computer visionalgorithms (e.g., the computer vision algorithms 116 of FIG. 1A).Example wake-up faces that may be trained into the CNN wake-up facerecognizer 532 may be stored into a local reference face metadatalibrary or reference face metadata database that stores metadata inassociation with corresponding reference face images or correspondingreference feature vectors of faces. The CNN wake-up face recognizer 532may confirm a presence of a face of interest in the low-resolutionvisual capture by comparing the pixel-based image or feature vectors ofthe face in the low-resolution visual capture to reference visualfeature definitions (e.g., reference face images or reference featurevectors) in the local reference image metadata library or database. Insome examples, an extended reference image metadata library or referenceimage metadata database may be stored at the cloud system 206, andaccessed by the CNN wake-up face recognizer 532 using an API for suchcloud-based library or database. The example CNN wake-up face recognizer532 sends a wake-up face detection confirmation to the CNN facerecognizer 534 when a wake-up face is detected. In the illustratedexample, the CNN wake-up face recognizer 532 also uses the localreference image metadata library or database and/or from the extendedreference image metadata library or database at the cloud system 206 togenerate face metadata corresponding to detected faces. Such facemetadata may be name of a person, age of a person, gender of a person,etc.

The example CNN face recognizer 534 analyzes the visual capture toidentify particular faces that the CNN face recognizer 534 is trained torecognize based on the computer vision algorithms 116. Recognition ofsuch particular faces causes the mobile camera 100, 204 to transition toa fully awake state. In the illustrated example, faces recognized by theCNN wake-up face recognizer 532 and the CNN face recognizer 534 are asubset of faces detected by the CNN face detector 530 such that thefaces detected by the CNN face detector 530 cause the mobile cameras100, 204 to transition to a higher power operating state (e.g., thehigh-resolution camera feature detection state 314 of FIGS. 3 and 4 ),but only a subset of the detected faces cause the mobile cameras 100,204 to transition to a fully awake state. The example CNN facerecognizer 534 outputs corresponding face metadata for differentrecognized faces shown in the example of FIG. 5A as face (1) throughface (n). In the illustrated example, a recognized face multiplexer 536receives the face metadata for the recognized face (1) through face (n),and provides the face metadata as generally indicated by referencenumeral 538 to the example full wake-up event multiplexer 510.

To perform high-resolution image analysis, the example VPU 108 isprovided with an example CNN object recognizer 542 that is in circuitwith the high-resolution camera 102 c. The example CNN object recognizer542 is provided to recognize objects near the mobile camera 100, 204 byanalyzing high-resolution visual captures from the high-resolutioncamera 102 c to identify particular objects that the CNN objectrecognizer 542 is trained to recognize based on the computer visionalgorithms 116. Recognition of such objects causes the mobile camera100, 204 to transition to a fully awake state. In the illustratedexample, the CNN object recognizer 542 generates object metadata byaccessing the metadata from a local reference object metadata library orreference object metadata database that stores metadata terms inassociation with corresponding reference object feature definitions.Example object metadata includes class of object (e.g., person, animal,natural feature, building, vehicle, etc.), vehicle (e.g., type, make,model, color, etc.), license plate (e.g., registered state, licenseplate number, etc.), etc. To retrieve object metadata, the CNN objectrecognizer 542 can compare object features from the high-resolutionvisual captures with the reference object feature definitions in thelocal reference object metadata library or database. In some examples,an extended reference object metadata library or reference objectmetadata database may be stored at the cloud system 206, and accessed bythe CNN object recognizer 542 using an API for such cloud-based libraryor database. The example CNN object recognizer 542 outputs correspondingobject metadata for different recognized objects shown in the example ofFIG. 5A as object (1) through object (n). In the illustrated example, arecognized object multiplexer 544 receives the object metadata for therecognized object (1) through object (n), and provides the objectmetadata as generally indicated by reference numeral 546 to the examplefull wake-up event multiplexer 510.

In the illustrated example of FIG. 5A, the VPU 108 is provided withtrigger feature multiplexers 554 having event select lines 556controllable by the VPU 108 to configure what metadata provided by thecomponents of the VPU 108 as described above are to cause the mobilecameras 100, 204 to transition between different operating states of theexample multiple power-level operating state hierarchy 300 of FIG. 3 .For example, as shown in FIG. 5B, to provide metadata-based wakeupevents to transition between different ones of the operating states, theVPU 108 is provided with an example power on reset (POR) statetransitioner 562, an example always on (AoN) state transitioner 564, anexample primary event state transitioner 566, an example secondary eventstate transitioner 568, an example tertiary event state transitioner570, and an example fully active state transitioner 572. In theillustrated example, the power on reset state transitioner 562 generatesa wakeup event to transition the mobile camera 100, 204 out of the resetstate 302 of FIGS. 3 and 4 . The AoN state transitioner 564 of theillustrated example generates a wakeup event to transition the mobilecameras 100, 204 out of the low-resolution camera feature detectionstate 308 based on the low-resolution camera 102 a (FIG. 5A) beingsupplied minimal electrical power to perform pre-processing featuredetection processes to identify whether a region of interest (RoI) eventis detected. The primary event state transitioner 566, the secondaryevent state transitioner 568, and the tertiary event state transitioner570 generate wakeup events to transition the mobile camera 100, 204between different ones of the motion feature detection state 304, theaudio feature detection state 306, the low-resolution camera featuredetection state 308, the computer vision processing feature detectionstate 310, the CNN feature detection state 312, the high-resolutioncamera feature detection state 314, and/or the video capture state 316of FIGS. 3 and 4 based on different combinations of motion feature(s),audio feature(s), and/or visual feature(s) from the different componentsof the VPU 108 that are selected by the VPU 108 via the event selectlines 556 of the trigger feature multiplexers 554. In some examples moreor fewer event state transitioners may be provided to the VPU 108. Insome examples, a separate state transitioner is provided for each one ofthe motion feature detection state 304, the audio feature detectionstate 306, the low-resolution camera feature detection state 308, thecomputer vision processing feature detection state 310, the CNN featuredetection state 312, the high-resolution camera feature detection state314, and the video capture state 316 of FIGS. 3 and 4 .

In the illustrated example of FIG. 5A, the full wake-up eventmultiplexer 510 is provided with metadata select lines 576 that areconfigurable by the VPU 108 to select different combinations of inputmetadata corresponding to the recognized motion activity(ies), therecognized command word(s), the recognized face(s), and the recognizedobject(s) that are to cause the mobile cameras 100, 204 to transition toa fully awake state. For example, based on selections of the metadataselect lines 576 and the input metadata to the example full wake-upevent multiplexer 510, the full wake-up event multiplexer 510 providesmetadata output 550. The metadata output 550 is provided to the fullyactive state transitioner 572 (FIG. 5B) to cause the VPU 108 to fullyawake the mobile camera 100, 204. In the illustrated example, when in afully awake state, the VPU 108 enables a communications subsystem andthe wireless communication interface 110 (FIGS. 1A and 1B) to send themetadata output 550 (e.g., the metadata generally indicated by referencenumerals 508, 524, 538, and/or 546) to a corresponding mobile phone hostdevice 202 and/or the cloud system 206 (FIG. 2 ). The example metadataoutput 550 may include one or more of the metadata received at the fullwake-up event multiplexer 510. For example, based on the controlling ofthe metadata select lines 576 of the full wake-up event multiplexer 510,the metadata output 550 may include one or more of the input metadatacorresponding to the recognized motion activity(ies), the recognizedcommand word(s), the recognized face(s), and/or the recognizedobject(s).

FIG. 5C depicts an example state-order configurator 582 that may be usedwith the VPU 108 depicted in FIGS. 5A and 5B to configure the orderingof the different power-level operating states of the example multiplepower-level operating state hierarchy 300 of FIG. 3 . The examplestate-order configurator 582 arranges and/or rearranges the operatingstates and activations of corresponding sensors in the multiplepower-level operating state hierarchy 300 so that the example statetransitioners 566, 668, 570, 572 cause different sequences oftransitions between operating states and corresponding sensors along themultiple power-level operating state hierarchy 300. For example, toimplement such ordering of operating states, the state-orderconfigurator 582 is provided with configurable logic circuits to directdifferent ones of the inputs from the trigger feature multiplexers 554of FIG. 5A to different ones of the example state transitioners 566,668, 570, 572. In some examples, the state-order configurator 582reorders the order of the different power-level operating states of theexample multiple power-level operating state hierarchy 300 based on theinputs from the trigger feature multiplexers 554. For example, when acombination of events is detected within a short threshold duration, thestate-order configurator 582 may control the paths between the triggerfeature multiplexers 554 and the different ones of the example statetransitioners 566, 668, 570, 572 to transition to a differentpower-level operating state than would be transitioned if suchcombination of events were not detected or if a different combination ofevents were detected. For example, in response to a detection ofhigh-speed movement (e.g., driving a car) and a concurrent detection ofa screeching sound (e.g., tires skidding), the state-order configurator582 may control the paths between the trigger feature multiplexers 554and the different ones of the example state transitioners 566, 668, 570,572 to transition from the example motion feature detection state 304 tothe example video capture state 316. This may be useful to capture videoof an imminent vehicular accident.

In the illustrated example, the state-order configurator 582 enables theordering of the operating states of the multiple power-level operatingstate hierarchy 300 to be dynamically modified. In some examples, suchmodifications are on policy definitions. In such examples, or otherexamples, such modifications implemented using firmware, software,and/or control registers. In some examples, the state-order configurator582 enables the mobile camera 100, 204 to skip one or more operatingstates to move to higher or lower power states along the multiplepower-level operating state hierarchy 300.

While an example manner of implementing the mobile camera 100, 204 andthe VPU 108 are illustrated in FIGS. 1A, 1B, 2, 5A, 5B, and 5C, one ormore of the elements, processes and/or devices illustrated in FIGS. 1A,1B, 2, 5A, 5B, and 5C may be combined, divided, re-arranged, omitted,eliminated and/or implemented in any other way. Further, the example CNNfeature analyzers 114, the example computer vision algorithms 116,and/or the example digital signal processors 118 of FIG. 1A, the examplemotion feature detector 502, the example CNN motion activity recognizer504, the example motion activity multiplexer 506, the example fullwake-up event multiplexer 510, the example audio feature detector 514,the example voice activity detector 516, the example CNN wake-up wordrecognizer 518, the example CNN command word recognizer 520, the examplecommand word multiplexer 522, the example image feature detector 528,the example CNN face detector 530, the example CNN wake-up facerecognizer 532, the example CNN face recognizer 534, the examplerecognized face multiplexer 536, the example CNN object recognizer 542,and/or the example trigger feature multiplexers 554 of FIG. 5A, theexample POR state transitioner 562, the example AoN state transitioner564, the example primary event state transitioner 566, the examplesecondary event state transitioner 568, the example tertiary event statetransitioner 570, and/or the example fully active state transitioner 572of FIG. 5B, and/or the example state-order configurator 582 of FIG. 5C,and/or, more generally, the example mobile camera 100, 204 and/or VPU108 may be implemented by hardware, software, firmware and/or anycombination of hardware, software and/or firmware. Thus, for example,any of the example CNN feature analyzers 114, the example computervision algorithms 116, and/or the example digital signal processors 118of FIG. 1A, the example motion feature detector 502, the example CNNmotion activity recognizer 504, the example motion activity multiplexer506, the example full wake-up event multiplexer 510, the example audiofeature detector 514, the example voice activity detector 516, theexample CNN wake-up word recognizer 518, the example CNN command wordrecognizer 520, the example command word multiplexer 522, the exampleimage feature detector 528, the example CNN face detector 530, theexample CNN wake-up face recognizer 532, the example CNN face recognizer534, the example recognized face multiplexer 536, the example CNN objectrecognizer 542, and/or the example trigger feature multiplexers 554 ofFIG. 5A, the example POR state transitioner 562, the example AoN statetransitioner 564, the example primary event state transitioner 566, theexample secondary event state transitioner 568, the example tertiaryevent state transitioner 570, and/or the example fully active statetransitioner 572 of FIG. 5B, and/or the example state-order configurator582 of FIG. 5C and/or, more generally, the example mobile camera 100,204 and/or VPU 108 could be implemented by one or more analog or digitalcircuit(s), logic circuits, programmable processor(s), programmablecontroller(s), graphics processing unit(s) (GPU(s)), digital signalprocessor(s) (DSP(s)), application specific integrated circuit(s)(ASIC(s)), programmable logic device(s) (PLD(s)) and/or fieldprogrammable logic device(s) (FPLD(s)). When reading any of theapparatus or system claims of this patent to cover a purely softwareand/or firmware implementation, at least one of the example CNN featureanalyzers 114, the example computer vision algorithms 116, and/or theexample digital signal processors 118 of FIG. 1A, the example motionfeature detector 502, the example CNN motion activity recognizer 504,the example motion activity multiplexer 506, the example full wake-upevent multiplexer 510, the example audio feature detector 514, theexample voice activity detector 516, the example CNN wake-up wordrecognizer 518, the example CNN command word recognizer 520, the examplecommand word multiplexer 522, the example image feature detector 528,the example CNN face detector 530, the example CNN wake-up facerecognizer 532, the example CNN face recognizer 534, the examplerecognized face multiplexer 536, the example CNN object recognizer 542,and/or the example trigger feature multiplexers 554 of FIG. 5A, theexample POR state transitioner 562, the example AoN state transitioner564, the example primary event state transitioner 566, the examplesecondary event state transitioner 568, the example tertiary event statetransitioner 570, and/or the example fully active state transitioner 572of FIG. 5B, and/or the example state-order configurator 582 of FIG. 5Cis/are hereby expressly defined to include a non-transitory computerreadable storage device or storage disk such as a memory, a digitalversatile disk (DVD), a compact disk (CD), a Blu-ray disk, etc.including the software and/or firmware. Further still, the examplemobile camera 100, 204 and/or the VPU 108 may include one or moreelements, processes and/or devices in addition to, or instead of, thoseillustrated in FIGS. 1A, 1B, 2, 5A, 5B, and 5C and/or may include morethan one of any or all of the illustrated elements, processes anddevices. As used herein, the phrase “in communication,” includingvariations thereof, encompasses direct communication and/or indirectcommunication through one or more intermediary components, and does notrequire direct physical (e.g., wired) communication and/or constantcommunication, but rather additionally includes selective communicationat periodic intervals, scheduled intervals, aperiodic intervals, and/orone-time events.

In some examples disclosed herein, means for recognizing features insensor data may be implemented using one or more of the CNN featureanalyzers 114 of FIG. 1A, the example CNN motion activity recognizer504, the example CNN wake-up word recognizer 518, the example CNNcommand word recognizer 520, the example CNN wake-up face recognizer532, the example CNN face recognizer 534, and/or the example CNN objectrecognizer 542 of FIG. 5A. In some examples disclosed herein, means fortransitioning the mobile camera 100, 204 between different featuredetection states (e.g., the motion feature detection state 304, theaudio feature detection state 306, the low-resolution camera featuredetection state 308, the computer vision processing feature detectionstate 310, the CNN feature detection state 312, the high-resolutioncamera feature detection state 314, and/or the video capture state 316of FIGS. 3 and 4 ) may be implemented using one or more of the examplePOR state transitioner 562, the example AoN state transitioner 564, theexample primary event state transitioner 566, the example secondaryevent state transitioner 568, the example tertiary event statetransitioner 570, and/or the example fully active state transitioner 572of FIG. 5B. In some examples disclosed herein, means for communicatingmay be implemented by the wireless communication interface 110 of FIGS.1A and 1B and/or by the interface circuit 720 of FIG. 7 . In someexamples, means for detecting features may be implemented by one or moreof the motion feature detector 502, the audio feature detector 515,and/or the image feature detector 528 of FIG. 5A. In some examplesdisclosed herein, means for configuring operating state order may beimplemented by the example state-order configurator 582 of FIG. 5C.

A flowchart representative of example hardware logic or machine-readableinstructions for implementing the mobile camera 100, 204 and/or the VPU108 of FIGS. 1A, 1B, 2, 5A, 5B, and 5C is shown in FIG. 6 . Themachine-readable instructions may be a program or portion of a programfor execution by a processor such as the VPU 108 and/or the processor712 shown in the example processor platform 700 discussed below inconnection with FIG. 7 . The program may be embodied in software storedon a non-transitory computer readable storage medium such as a CD-ROM, afloppy disk, a hard drive, a DVD, a Blu-ray disk, or a memory associatedwith the processor 712, but the entire program and/or parts thereofcould alternatively be executed by a device other than the processor 712and/or embodied in firmware or dedicated hardware. Further, although theexample program is described with reference to the flowchart illustratedin FIG. 6 , many other methods of implementing the example mobile camera100, 204 and/or the VPU 108 may alternatively be used. For example, theorder of execution of the blocks may be changed, and/or some of theblocks described may be changed, eliminated, or combined. Additionallyor alternatively, any or all of the blocks may be implemented by one ormore hardware circuits (e.g., discrete and/or integrated analog and/ordigital circuitry, an FPGA, an ASIC, a comparator, anoperational-amplifier (op-amp), a logic circuit, etc.) structured toperform the corresponding operation without executing software orfirmware.

As mentioned above, the example process of FIG. 6 may be implementedusing executable instructions (e.g., computer and/or machine readableinstructions) stored on a non-transitory computer and/or machinereadable medium such as a hard disk drive, a flash memory, a read-onlymemory, a compact disk, a digital versatile disk, a cache, arandom-access memory and/or any other storage device or storage disk inwhich information is stored for any duration (e.g., for extended timeperiods, permanently, for brief instances, for temporarily buffering,and/or for caching of the information). As used herein, the termnon-transitory computer readable medium is expressly defined to includeany type of computer readable storage device and/or storage disk and toexclude propagating signals and to exclude transmission media.

The terms “including” and “comprising” (and all forms and tensesthereof) are used herein to be open ended terms. Thus, whenever a claimemploys any form of “include” or “comprise” (e.g., comprises, includes,comprising, including, having, etc.) as a preamble or within a claimrecitation of any kind, it is to be understood that additional elements,terms, etc. may be present without falling outside the scope of thecorresponding claim or recitation. As used herein, when the phrase “atleast” is used as the transition term in, for example, a preamble of aclaim, it is open-ended in the same manner as the term “comprising” and“including” are open ended. The term “and/or” when used, for example, ina form such as A, B, and/or C refers to any combination or subset of A,B, C such as (1) A alone, (2) B alone, (3) C alone, (4) A with B, (5) Awith C, and (6) B with C.

Turning in detail to FIG. 6 , the example program transitions the mobilecamera 100, 204 between first and second feature detection states. Thefeature detection states may be any of the operating states of theexample multiple power-level operating state hierarchy 300 of FIG. 3 .Thus, example operations represented in FIG. 6 may be performed by anycomponents of a mobile camera 100, 204 and/or the VPU 108 of FIGS. 1A,1B, 5A, 5B, and/or 5C corresponding to the feature detection states forwhich the example program of FIG. 6 is used.

The program of FIG. 6 begins at block 602 at which the example VPU 108(FIGS. 1A, 1B, 6A and 6B) accesses sensor data. For example, the sensordata may be motion sensor data, audio sensor data, and/or visual capturedata obtained from the motion feature detector 502, the audio featuredetector 514, and/or the image feature detector 528 of FIG. 5A. Theexample VPU 108 determines whether a feature of interest has beendetected in the sensor data (block 604). In some examples, the motionfeature detector 502 analyzes the sensor data for a motion featurehaving sufficient magnitude and/or sufficient duration to satisfy amotion feature trigger threshold. In some examples, the audio featuredetector 514 analyzes the sensor data for an audio feature havingsufficient amplitude and/or sufficient duration to satisfy an audiofeature trigger threshold. In some examples, the image feature detector528 analyzes the sensor data for a visual feature having sufficientvisual definition and/or sufficient duration to satisfy a visual featuretrigger threshold. If a feature of interest has not been detected atblock 604, control returns to block 602 to obtain further sensor data toanalyze.

When the VPU 108 determines at block 604 that a feature of interest isdetected in the sensor data, the example VPU 108 performs a featurerecognition analysis on the sensor data (block 606). In some examples,motion activity recognition is performed by the CNN motion activityrecognizer 504 (FIG. 5A). In some examples, word recognition isperformed by the CNN wake-up word recognizer 518 and/or the CNN commandword recognizer 520 (FIG. 5A). In some examples, face recognition isperformed by the CNN wake-up face recognizer 532 and/or the CNN facerecognizer 534 (FIG. 5A). The example VPU 108 generates correspondingmetadata for a recognized feature in the sensor data (block 608). Insome examples, the CNN motion activity recognizer 504 generates motionmetadata. In some examples, the CNN wake-up word recognizer 518 and/orthe CNN command word recognizer 520 generate(s) audio metadata. In someexamples, the CNN wake-up face recognizer 532 and/or the CNN facerecognizer 534 generate(s) face metadata. The example VPU 108 determineswhether to transition the mobile camera 100, 204 to another operatingstate (block 610). For example, a state transitioner 562, 564, 566, 568,570, or 572 (FIG. 5B) corresponding to a current operating state of themobile camera 100, 204 may determine whether to transition the mobilecamera 100, 204 to another operating state based on whether the featureof interest recognized at block 606 satisfies a threshold to warrantsuch state transition. If the example VPU 108 determines at block 610 tonot transition the mobile camera 100, 204 to another operating state,control returns to block 602 to obtain further sensor data to analyze.

When the example VPU 108 determines at block 610 to transition themobile camera 100, 204 to another operating state, the VPU 108transitions the mobile camera 100, 204 from a current feature detectionstate to a next feature detection state (block 612). For example, astate transitioner 562, 564, 566, 568, 570, or 572 corresponding to acurrent operating state of the mobile camera 100, 204 transitions themobile camera 100, 204 from a current feature detection state to a nextfeature detection state based on the feature of interest recognized atblock 606. In some examples, the next feature detection statecontributes to relatively higher power consumption by the mobile camera100, 204 than the current feature detection state in which the mobilecamera 100, 204 operates before the transition of block 612. In someexamples, the example state-order configurator 582 of FIG. 5Ccontributes to the implementation of block 612 by controlling orconfiguring the ordering of the operating states between which thetransition occurs at block 612.

The example VPU 108 accesses sensor data (block 614). For example, afeature detector 502, 514, 528 (FIG. 5A) corresponding to the operatingstate into which the mobile camera 100, 204 transitioned to at block 612obtains corresponding sensor data. In examples in which the VPU 108transitions the mobile camera 100, 204 to the high-resolution camerafeature detection state 314 and/or the video capture state 316, the CNNobject recognizer 542 obtains the sensor data at block 614. The exampleVPU 108 determines whether a feature of interest has been detected inthe sensor data (block 616). For example, a feature detector 502, 514,528 may perform a feature detection analysis at block 616 on the sensordata to determine if a feature of interest is present in the sensordata. In some examples involving sensor data that represents visualcaptures, the CNN face detector 530 of FIG. 5A may perform a featuredetection analysis on the sensor data at block 616 after the imagefeature detector 528 detects a visual feature of interest in the sensordata. In some examples involving sensor data that includes audio data,the voice activity detector 516 of FIG. 5A may perform a featuredetection analysis on the sensor data at block 616 after the audiofeature detector 514 detects an audio feature of interest in the sensordata. If a feature of interest has not been detected at block 616,control returns to block 614 to obtain further sensor data to analyze.In some examples, after a threshold duration of time or a thresholdnumber of times that the VPU 108 does not detect a feature of interestin the sensor data at block 616, the VPU 108 may transition the camera100, 204 back to a previous operating state, and control returns toblock 602.

When the VPU 108 determines at block 616 that a feature of interest hasbeen detected in the sensor data, the example VPU 108 performs a featurerecognition analysis on the sensor data (block 618). In the illustratedexample, the feature recognition analysis is performed by a CNNrecognizer 504, 518, 520, 532, 534, and/or 542 of FIG. 5A correspondingto the operating state in which the mobile camera 100, 204 is currentlyoperating. The example VPU 108 generates corresponding metadata for arecognized feature in the sensor data (block 620). The example VPU 108determines whether to send collected information to an externaldestination (block 622). For example, the VPU 108 can determine based oninputs to the full wake-up event multiplexer 510 (FIG. 5A) whether tosend the metadata generated at block 620 and/or block 608 as themetadata output 550 from the mobile camera 100, 204 to a correspondingmobile phone host device 202 (FIG. 2 ), to another mobile camera 100,204, and/or to the cloud system 206 (FIG. 2 ). In some examples, the VPU108 additionally or alternatively determines whether to send the sensordata from block 602 and/or block 614 to an external destination. If theVPU 108 determines at block 622 to not send the collected information toan external destination, control returns to block 614 to access furthersensor data.

When the example VPU 108 determines at block 622 to send the collectedinformation to an external destination, the VPU 108 enables the wirelesscommunication interface 110 (FIGS. 1A and 1B) (block 624). For example,the fully active state transitioner 572 (FIG. 5B) provides power to thewireless communication interface 110 and/or sets an enable line of thewireless communication interface 110 to its active state. The exampleVPU 108 sends the collected information (block 626). For example, theVPU 108 may send the metadata generated at block 620 and/or block 608and/or the sensor data from block 602 and/or block 614 from the mobilecamera 100, 204 to a corresponding mobile phone host device 202, toanother mobile camera 100, 204, and/or to the cloud system 206. In someexamples, the mobile phone host device 202 and/or the other mobilecamera 100, 204, in turn, send(s) the collected information to the cloudsystem 206. The example process of FIG. 6 ends.

FIG. 7 illustrates a block diagram of an example processor platform 700structured to execute the instructions of FIG. 6 to implement the mobilecamera 100, 204 of FIGS. 1A, 1B, and 2 and/or the VPU 108 of FIGS. 1A,1B, 5A, 5B, and 5C. The processor platform 700 can be, for example, acamera, a computer, a self-learning machine (e.g., a neural network), amobile device (e.g., a cell phone, a smart phone, a tablet such as aniPad™), a personal digital assistant (PDA), an Internet appliance, adigital video recorder, a gaming console, a personal video recorder, aheadset or other wearable device, or any other type of computing device.

The processor platform 700 of the illustrated example includes aprocessor 712. The processor 712 of the illustrated example is hardware.For example, the processor 712 can be implemented by one or moreintegrated circuits, logic circuits, microprocessors, GPUs, DSPs, orcontrollers from any desired family or manufacturer. The hardwareprocessor 712 may be a semiconductor based (e.g., silicon based) device.In some examples, the processor 712 implements the VPU 108. In thisexample, the processor implements the example CNN feature analyzers 114,the example computer vision algorithms 116, and/or the example digitalsignal processors 118 of FIG. 1A, the example motion feature detector502, the example CNN motion activity recognizer 504, the example motionactivity multiplexer 506, the example full wake-up event multiplexer510, the example audio feature detector 514, the example voice activitydetector 516, the example CNN wake-up word recognizer 518, the exampleCNN command word recognizer 520, the example command word multiplexer522, the example image feature detector 528, the example CNN facedetector 530, the example CNN wake-up face recognizer 532, the exampleCNN face recognizer 534, the example recognized face multiplexer 536,the example CNN object recognizer 542, and/or the example triggerfeature multiplexers 554 of FIG. 5A, the example POR state transitioner562, the example AoN state transitioner 564, the example primary eventstate transitioner 566, the example secondary event state transitioner568, the example tertiary event state transitioner 570, and/or theexample fully active state transitioner 572 of FIG. 5B, and/or theexample state-order configurator 582 of FIG. 5C.

The processor 712 of the illustrated example includes a local memory 713(e.g., a cache). The processor 712 of the illustrated example is incommunication with a main memory including a volatile memory 714 and anon-volatile memory 716 via a bus 718. The volatile memory 714 may beimplemented by Synchronous Dynamic Random Access Memory (SDRAM), DynamicRandom Access Memory (DRAM), RAMBUS® Dynamic Random Access Memory(RDRAM®) and/or any other type of random access memory device. Thenon-volatile memory 716 may be implemented by flash memory and/or anyother desired type of memory device. Access to the main memory 714, 716is controlled by a memory controller.

The processor platform 700 of the illustrated example also includes aninterface circuit 720. The interface circuit 720 may be implemented byany type of interface standard, such as an Ethernet interface, auniversal serial bus (USB), a Wi-Fi interface, a Bluetooth® interface,Zigbee® interface, a near field communication (NFC) interface, and/or aPCI express interface.

In the illustrated example, one or more input devices 722 are connectedto the interface circuit 720. The input device(s) 722 permit(s) a userto enter data and/or commands into the processor 712. The inputdevice(s) can be implemented by, for example, an audio sensor, amicrophone, a camera (still or video), a motion sensor, a keyboard, abutton, a mouse, a touchscreen, a track-pad, a trackball, isopointand/or a voice recognition system.

One or more output devices 724 are also connected to the interfacecircuit 720 of the illustrated example. The output devices 724 can beimplemented, for example, by display devices (e.g., a light emittingdiode (LED), an organic light emitting diode (OLED), a liquid crystaldisplay (LCD), a cathode ray tube display (CRT), an in-place switching(IPS) display, a touchscreen, etc.), a tactile output device, a printerand/or a speaker. The interface circuit 720 of the illustrated example,thus, typically includes a graphics driver card, a graphics driver chipand/or a graphics driver processor.

The interface circuit 720 of the illustrated example also includes acommunication device such as a transmitter, a receiver, a transceiver, amodem, a residential gateway, a wireless access point, and/or a networkinterface to facilitate exchange of data with external machines (e.g.,computing devices of any kind) via a network 726. The communication canbe via, for example, an Ethernet connection, a digital subscriber line(DSL) connection, a telephone line connection, a coaxial cable system, asatellite system, a line-of-site wireless system, a cellular telephonesystem, etc.

The processor platform 700 of the illustrated example also includes oneor more mass storage devices 728 for storing software and/or data.Examples of such mass storage devices 728 include floppy disk drives,hard drive disks, compact disk drives, Blu-ray disk drives, redundantarray of independent disks (RAID) systems, and digital versatile disk(DVD) drives.

Machine executable instructions 732 representative of the examplemachine-readable instructions of FIG. 6 may be stored in the massstorage device 728, in the volatile memory 714, in the non-volatilememory 716, and/or on a removable non-transitory computer readablestorage medium such as a CD or DVD.

From the foregoing, it will be appreciated that example methods,apparatus, and articles of manufacture have been disclosed to operatemobile cameras having limited power sources while enabling numerous usesfor the mobile cameras for productivity, entertainment, and as assistivetechnologies that assist users in their day-to-day activities. Examplemobile cameras disclosed herein operate in a low-power featuremonitoring mode and one or more higher-power active modes. The low-powerfeature monitoring mode enables a mobile camera to monitorcharacteristics of its surrounding environment while consumingsubstantially little power (e.g., ˜2 milliwatts). In the low-powerfeature monitoring mode, environment analysis logic of an example mobilecamera monitors environmental characteristics to identify features ofinterest representing stimuli that warrant transitioning the mobilecamera to a higher-power active mode in which the mobile camera canmonitor additional types of environmental characteristics and/or capturehigh-quality visual captures. In such manners, examples disclosed hereinenable mobile cameras to operate in power-constrained configurations forlong durations while the mobile cameras intelligently operateintermittently in higher-power modes to capture high-quality data suchas high-resolution visual captures of their surrounding environments.

Examples disclosed herein also enable mobile cameras to transmitmetadata generated from collected sensor data (e.g., motion data, audiodata, visual captures, etc.) instead of transmitting the sensor dataitself. Since metadata is smaller in data size than raw sensor data,transmitting the sensor data from the mobile cameras to host devices ora cloud service conserves network bandwidth, thus, reducing networkcongestion and increasing the speed at which such metadata can bereceived at its destination locations. It also reduces power consumptionof the mobile cameras due to needing to transmit less data due to themetadata being of smaller data size than raw sensor data. Such powerconsumption reduction is especially significant with respect to usingWi-Fi communications, which can be especially demanding on powerrequirements for performing transmissions. Reducing power consumption inthis manner is useful in small portable electronics, such as mobilecameras, that have small batteries and, thus, small charge capacities.In addition, transmitting metadata across a network from the mobilecameras protects privacies of persons and/or private/personal propertyby not revealing raw sensor data that could be used to identify suchpersons and/or private/personal property. As such, examples disclosedherein can be used to reduce network congestion and protect privacies ofpersons by transmitting metadata about sensor data from mobile camerasto destination locations across a network.

The following pertain to further examples disclosed herein.

Example 1 is a mobile camera. The mobile camera of Example 1 includes afirst convolutional neural network to recognize a first feature in firstsensor data in response to the first feature being detected in the firstsensor data; a state transitioner to transition the mobile camera from afirst feature detection state to a second feature detection state inresponse to the first convolutional neural network recognizing the firstfeature, the mobile camera to operate using higher power consumption inthe second feature detection state than in the first feature detectionstate; a second convolutional neural network to recognize a secondfeature in second sensor data in the second feature detection state; anda communications interface to send to an external device at least one offirst metadata corresponding to the first feature or second metadatacorresponding to the second feature.

In Example 2, the subject matter of Example 1 can optionally include animage feature detector in circuit with a low-resolution camera, thelow-resolution camera to provide the first sensor data in the firstfeature detection state, the image feature detector to detect the firstfeature in the first sensor data; and a high-resolution camera having astandby mode when the mobile camera is in the first feature detectionstate and having an active mode when the mobile camera is in the secondfeature detection state.

In Example 3, the subject matter of any one of Examples 1-2 canoptionally include a feature detector to determine whether the firstfeature satisfies a feature trigger threshold, the first convolutionalneural network to generate the first metadata in response the firstfeature satisfying the feature trigger threshold.

In Example 4, the subject matter of any one of Examples 1-3 canoptionally include a motion feature detector in circuit with an inertialmeasurement unit, the first sensor data provided by a motion sensor incircuit with the inertial measurement unit, and the motion featuredetector to detect the first feature in the first sensor data.

In Example 5, the subject matter of any one of Examples 1-4 canoptionally include that the first convolutional neural network is togenerate the first metadata by comparing the first feature to areference motion feature definition in a reference motion metadatalibrary.

In Example 6, the subject matter of any one of Examples 1-5 canoptionally include an audio feature detector in circuit with an audiocodec, the first sensor data being audio data, and the audio featuredetector to detect the first feature in the audio data.

In Example 7, the subject matter of any one of Examples 1-6 canoptionally include that the first convolutional neural network is togenerate the first metadata by comparing the first feature to areference audio feature definition in a reference audio metadatalibrary.

In Example 8, the subject matter of any one of Examples 1-7 canoptionally include that the audio feature detector is to detect thefirst feature in the audio data based on at least one of: (a) speech,(b) a vehicle sound, (c) or a rate of change in an audio signalreflected in the audio data.

In Example 9, the subject matter of any one of Examples 1-8 canoptionally include an image feature detector in circuit with alow-resolution camera, the first sensor data being a visual capture, andthe image feature detector to detect the first feature in the visualcapture.

In Example 10, the subject matter of any one of Examples 1-9 canoptionally include that the first convolutional neural network is togenerate the first metadata by comparing the first feature to areference visual feature definition in a reference image metadatalibrary.

In Example 11, the subject matter of any one of Examples 1-10 canoptionally include that the image feature detector is to detect thefirst feature in the visual capture based on at least one of: (a) anedge, (b) a line, (c) or a face in the visual capture.

In Example 12, the subject matter of any one of Examples 1-11 canoptionally include that the external device is at least one of a mobilephone, a second mobile camera, or a wearable device.

Example 13 is a mobile camera. The mobile camera of Example 13 includesfirst means for recognizing a first feature in first sensor data inresponse to the first feature being detected in the first sensor data;means for transitioning the mobile camera from a first feature detectionstate to a second feature detection state in response to the recognizingof the first feature, the second feature detection state to contributeto relatively higher power consumption by the mobile camera than thefirst feature detection state; second means for recognizing a secondfeature in second sensor data collected; and means for communicating toan external device at least one of first metadata corresponding to thefirst feature or second metadata corresponding to the second feature.

In Example 14, the subject matter of Example 13 can optionally includemeans for detecting features to detect the first feature in the firstsensor data.

In Example 15, the subject matter of any one of Examples 13-14 canoptionally include the means for detecting features is to determinedetect the first feature based on determining that the first featuresatisfies a feature trigger threshold, the first means for recognizingto generate the first metadata after the means for detecting featuresdetermines that the first feature satisfies the feature triggerthreshold.

In Example 16, the subject matter of any one of Examples 13-15 canoptionally include means for detecting features to detect the firstfeature in motion data of the first sensor data provided by an inertialmeasurement unit.

In Example 17, the subject matter of any one of Examples 13-16 canoptionally include the first means for recognizing is to compare thefirst feature to a reference motion feature definition in a referencemotion metadata library to generate the first metadata.

In Example 18, the subject matter of any one of Examples 13-17 canoptionally include means for detecting features to detect the firstfeature in audio data of the first sensor data.

In Example 19, the subject matter of any one of Examples 13-18 canoptionally include that the first means for recognizing is to comparethe first feature to a reference audio feature definition in a referenceaudio metadata library to generate the first metadata.

In Example 20, the subject matter of any one of Examples 13-19 canoptionally include that the means for detecting features is to detectthe first feature in the audio data based on at least one of: (a)speech, (b) a vehicle sound, (c) or a rate of change in an audio signalreflected in the audio data.

In Example 21, the subject matter of any one of Examples 13-20 canoptionally include means for detecting features is to detect the firstfeature in a visual capture represented by the first sensor data.

In Example 22, the subject matter of any one of Examples 13-21 canoptionally include that the first means for recognizing is to comparethe first feature to a reference visual feature definition in areference image metadata library to generate the first metadata.

In Example 23, the subject matter of any one of Examples 13-22 canoptionally include that the means for detecting features is to detectthe first feature in the visual capture based on at least one of: (a) anedge, (b) a line, (c) or a face in the visual capture.

In Example 24, the subject matter of any one of Examples 13-23 canoptionally include that the external device is at least one of a mobilephone, a second mobile camera, or a wearable device.

Example 25 is a non-transitory computer readable storage mediumcomprising instructions that, when executed, cause at least oneprocessor to at least recognize a first feature in first sensor data inresponse to the first feature being detected in the first sensor data;transition a mobile camera from a first feature detection state to asecond feature detection state in response to the recognizing of thefirst feature, the mobile camera to operate using higher powerconsumption in the second feature detection state than in the firstfeature detection state; recognize a second feature in second sensordata in the second feature detection state; and send to an externaldevice at least one of first metadata corresponding to the first featureor second metadata corresponding to the second feature.

In Example 26, the subject matter of Example 25 can optionally includethat the instructions further cause the at least one processor to set ahigh-resolution camera to a standby mode in the first feature detectionstate; access the first sensor data as a visual capture provided by alow-resolution camera in the first feature detection state; detect thefirst feature in the first sensor data; and set the high-resolutioncamera to an active mode in the second feature detection state.

In Example 27, the subject matter of any one of Examples 25-26 canoptionally include that the instructions further cause the at least oneprocessor to determine whether the first feature satisfies a featuretrigger threshold; and generate the first metadata in response the firstfeature satisfying the feature trigger threshold.

In Example 28, the subject matter of any one of Examples 25-27 canoptionally include that the instructions further cause the at least oneprocessor to access the first sensor data as motion data provided by amotion sensor in circuit with an inertial measurement unit; and detectthe first feature in the motion data.

In Example 29, the subject matter of any one of Examples 25-28 canoptionally include that the instructions are further to cause the atleast one processor to generate the first metadata by comparing thefirst feature to a reference motion feature definition in a referencemotion metadata library.

In Example 30, the subject matter of any one of Examples 25-29 canoptionally include that the instructions are further to cause the atleast one processor to access the first sensor data as audio dataprovided by an audio codec; and detect the first feature in the audiodata.

In Example 31, the subject matter of any one of Examples 25-30 canoptionally include that the instructions are further to cause the atleast one processor to generate the first metadata by comparing thefirst feature to a reference audio feature definition in a referenceaudio metadata library.

In Example 32, the subject matter of any one of Examples 25-31 canoptionally include that the instructions are further to cause the atleast one processor to detect the first feature in the audio data basedon at least one of: (a) speech, (b) a vehicle sound, (c) or a rate ofchange in an audio signal reflected in the audio data.

In Example 33, the subject matter of any one of Examples 25-32 canoptionally include that the instructions are further to cause the atleast one processor to access the first sensor data as a visual captureprovided by a low-resolution camera; and detect the first feature in thevisual capture.

In Example 34, the subject matter of any one of Examples 25-33 canoptionally include that the instructions are further to cause the atleast one processor to generate the first metadata by comparing thefirst feature to a reference visual feature definition in a referenceimage metadata library.

In Example 35, the subject matter of any one of Examples 25-34 canoptionally include that the instructions are further to cause the atleast one processor to detect the first feature in the visual capturebased on at least one of: (a) an edge, (b) a line, (c) or a face in thevisual capture.

In Example 36, the subject matter of any one of Examples 25-35 canoptionally include that the external device is at least one of a mobilephone, a second mobile camera, or a wearable device.

Example 37 is a method to operate a mobile camera. The method of Example37 includes recognizing, by executing an instruction with a processor, afirst feature in first sensor data in response to the first featurebeing detected in the first sensor data; transitioning, by executing aninstruction with the processor, the mobile camera from a first featuredetection state to a second feature detection state in response to therecognizing of the first feature, the mobile camera to operate usinghigher power consumption in second feature detection state than in thefirst feature detection state; recognizing, by executing an instructionwith the processor, a second feature in second sensor data in the secondfeature detection state; and sending to an external device, by executingan instruction with the processor, at least one of first metadatacorresponding to the first feature or second metadata corresponding tothe second feature.

In Example 38, the subject matter of Example 37 can optionally includesetting a high-resolution camera to a standby mode in the first featuredetection state; accessing the first sensor data as a visual captureprovided by a low-resolution camera in the first feature detectionstate; detecting the first feature in the first sensor data; and settingthe high-resolution camera to an active mode in the second featuredetection state.

In Example 39, the subject matter of any one of Examples 37-38 canoptionally include determining whether the first feature satisfies afeature trigger threshold; and generating the first metadata in responsethe first feature satisfying the feature trigger threshold.

In Example 40, the subject matter of any one of Examples 37-39 canoptionally include accessing the first sensor data as motion dataprovided by a motion sensor in circuit with an inertial measurementunit; and detecting the first feature in the motion data.

In Example 41, the subject matter of any one of Examples 37-40 canoptionally include generating the first metadata by comparing the firstfeature to a reference motion feature definition in a reference motionmetadata library.

In Example 42, the subject matter of any one of Examples 37-41 canoptionally include accessing the first sensor data as audio dataprovided by an audio codec; and detecting the first feature in the audiodata.

In Example 43, the subject matter of any one of Examples 37-42 canoptionally include generating the first metadata by comparing the firstfeature to a reference audio feature definition in a reference audiometadata library.

In Example 44, the subject matter of any one of Examples 37-43 canoptionally include detecting the first feature in the audio data basedon at least one of: (a) speech, (b) a vehicle sound, (c) or a rate ofchange in an audio signal reflected in the audio data.

In Example 45, the subject matter of any one of Examples 37-44 canoptionally include accessing the first sensor data as a visual captureprovided by a low-resolution camera; and detecting the first feature inthe visual capture.

In Example 46, the subject matter of any one of Examples 37-45 canoptionally include generating the first metadata by comparing the firstfeature to a reference visual feature definition in a reference imagemetadata library.

In Example 47, the subject matter of any one of Examples 37-46 canoptionally include detecting the first feature in the visual capturebased on at least one of: (a) an edge, (b) a line, (c) or a face in thevisual capture.

In Example 48, the subject matter of any one of Examples 37-47 canoptionally include that the external device is at least one of a mobilephone, a second mobile camera, or a wearable device.

Although certain example methods, apparatus and articles of manufacturehave been disclosed herein, the scope of coverage of this patent is notlimited thereto. On the contrary, this patent covers all methods,apparatus and articles of manufacture fairly falling within the scope ofthe claims of this patent.

What is claimed is:
 1. A mobile camera comprising: a plurality of statetransition circuits to transition the mobile camera between a pluralityof feature detection states; and state-order configurable circuitry incircuit with the state transition circuits, the state-order configurablecircuitry including configurable logic circuitry to activate differentones of the state transition circuits based on different combinations ofinputs, the state-order configurable circuitry to: based on a firstcombination of inputs, activate a first one of the state transitioncircuits to transition the mobile camera to a first one of the featuredetection states; and based on a second combination of inputs,reconfigure the configurable logic circuitry to: skip at least a secondone of the feature detection states by not activating a second one ofthe state transition circuits corresponding to the second one of thefeature detection states, and activate a third one of the statetransition circuits to transition the mobile camera from the first oneof the feature detection states to a third one of the feature detectionstates.
 2. The mobile camera of claim 1, wherein the mobile camera is toconsume less power in the third one of the feature detection states thanin the second one of the feature detection states.
 3. The mobile cameraof claim 1, wherein the mobile camera is to consume more power in thethird one of the feature detection states than in the first one of thefeature detection states.
 4. The mobile camera of claim 1, wherein thestate-order configurable circuitry is to, based on a third combinationof inputs, reconfigure the configurable logic circuitry to activate thesecond one of the state transition circuits to transition the mobilecamera from the first one of the feature detection states to the secondone of the feature detection states.
 5. The mobile camera of claim 1,wherein the first one of the feature detection states is a motionfeature detection state, the second one of the feature detection statesis a low-resolution feature detection state, and the third one of thefeature detection states is a high-resolution feature detection state.6. The mobile camera of claim 1, wherein the second combination ofinputs includes motion data and audio data.
 7. The mobile camera ofclaim 1, further including a convolutional neural network to: recognizea motion in motion data; generate metadata corresponding to the motion;and provide the metadata as an input of the second combination of inputsto the state-order configurable circuitry.
 8. A mobile cameracomprising: memory; instructions in the mobile camera; and processorcircuitry to execute the instructions to: transition the mobile camerabetween a plurality of feature detection states based on an orderedarrangement; activate different ones of state transition circuits basedon different combinations of inputs by: based on a first combination ofinputs, activating a first one of the state transition circuitsaccording to the ordered arrangement to transition the mobile camera toa first one of the feature detection states; and based on a secondcombination of inputs, reconfiguring configurable logic circuitry to:skip at least a second one of the feature detection states in theordered arrangement by not activating a second one of the statetransition circuits corresponding to the second one of the featuredetection states, and activate a third one of the state transitioncircuits to transition the mobile camera from the first one of thefeature detection states to a third one of the feature detection states.9. The mobile camera of claim 8, wherein the mobile camera is to consumeless power in the third one of the feature detection states than in thesecond one of the feature detection states.
 10. The mobile camera ofclaim 8, wherein the mobile camera is to consume more power in the thirdone of the feature detection states than in the first one of the featuredetection states.
 11. The mobile camera of claim 8, wherein theprocessor circuitry is to, based on a third combination of inputs,reconfigure the configurable logic circuitry to activate the second oneof the state transition circuits to transition the mobile camera fromthe first one of the feature detection states to the second one of thefeature detection states.
 12. The mobile camera of claim 8, wherein thefirst one of the feature detection states is an audio feature detectionstate, the second one of the feature detection states is alow-resolution feature detection state, and the third one of the featuredetection states is a high-resolution feature detection state.
 13. Themobile camera of claim 8, wherein the second combination of inputsincludes audio data and image data.
 14. A mobile camera comprising: atleast one memory; and processor circuitry including one or more of: atleast one of a central processor unit, a graphic processor unit or adigital signal processor, the at least one of the central processorunit, the graphic processor unit or the digital signal processor havingcontrol circuitry to control data movement within the processorcircuitry, arithmetic and logic circuitry to perform one or more firstoperations corresponding to instructions, and one or more registers tostore a result of the one or more first operations, the instructions inthe mobile camera; a Field Programmable Gate Array (FPGA), the FPGAincluding logic gate circuitry, a plurality of configurableinterconnections, and storage circuitry, the logic gate circuitry andinterconnections to perform one or more second operations, the storagecircuitry to store a result of the one or more second operations; orApplication Specific Integrated Circuitry including logic gate circuitryto perform one or more third operations; the processor circuitry toperform at least one of the first operations, the second operations, orthe third operations to instantiate: a plurality of state transitioncircuits to transition the mobile camera between a plurality of featuredetection states based on an operating state hierarchy; and state-orderconfigurable circuitry in circuit with the state transition circuits,the state-order configurable circuitry including configurable logiccircuitry to activate different ones of the state transition circuitsbased on different combinations of inputs, the state-order configurablecircuitry to: based on a first combination of inputs, activate a firstone of the state transition circuits according to the operating statehierarchy to transition the mobile camera to a first one of the featuredetection states; and based on a second combination of inputs,reconfigure the configurable logic circuitry to: skip at least a secondone of the feature detection states in the operating state hierarchy bynot activating a second one of the state transition circuitscorresponding to the second one of the feature detection states, andactivate a third one of the state transition circuits to transition themobile camera from the first one of the feature detection states to athird one of the feature detection states.
 15. The mobile camera ofclaim 14, wherein the mobile camera is to consume less power in thethird one of the feature detection states than in the second one of thefeature detection states.
 16. The mobile camera of claim 14, wherein themobile camera is to consume more power in the third one of the featuredetection states than in the first one of the feature detection states.17. The mobile camera of claim 14, wherein the state-order configurablecircuitry is to, based on a third combination of inputs, reconfigure theconfigurable logic circuitry to activate the second one of the statetransition circuits to transition the mobile camera from the first oneof the feature detection states to the second one of the featuredetection states.
 18. The mobile camera of claim 14, wherein the firstone of the feature detection states is a motion feature detection state,the second one of the feature detection states is an audio featuredetection state, and the third one of the feature detection states is ahigh-resolution feature detection state.
 19. The mobile camera of claim14, wherein the processor circuitry is to perform at least one of thefirst operations, the second operations, or the third operations toinstantiate a convolutional neural network to: recognize a audio inaudio data; generate metadata corresponding to the audio; and providethe metadata as an input of the second combination of inputs to thestate-order configurable circuitry.
 20. A non-transitory computerreadable storage medium comprising instructions that, when executed,cause processor circuitry to at least: transition a mobile camerabetween a plurality of feature detection states; activate different onesof state transition circuits based on different combinations of inputsby: based on a first combination of inputs, activating a first one ofthe state transition circuits to transition the mobile camera to a firstone of the feature detection states; and based on a second combinationof inputs, reconfiguring configurable logic circuitry to: skip at leasta second one of the feature detection states by not activating a secondone of the state transition circuits corresponding to the second one ofthe feature detection states, and activate a third one of the statetransition circuits to transition the mobile camera from the first oneof the feature detection states to a third one of the feature detectionstates.
 21. The non-transitory computer readable storage medium of claim20, wherein the mobile camera is to consume less power in the third oneof the feature detection states than in the second one of the featuredetection states.
 22. The non-transitory computer readable storagemedium of claim 20, wherein the mobile camera is to consume more powerin the third one of the feature detection states than in the first oneof the feature detection states.
 23. The non-transitory computerreadable storage medium of claim 20, wherein the instructions are tocause the processor circuitry to, based on a third combination ofinputs, reconfigure the configurable logic circuitry to activate thesecond one of the state transition circuits to transition the mobilecamera from the first one of the feature detection states to the secondone of the feature detection states.
 24. The non-transitory computerreadable storage medium of claim 20, wherein the first one of thefeature detection states is a motion feature detection state, the secondone of the feature detection states is a low-resolution featuredetection state, and the third one of the feature detection states is ahigh-resolution feature detection state.
 25. The non-transitory computerreadable storage medium of claim 20, wherein the second combination ofinputs includes motion data and audio data.